-- Logs begin at Tue 2022-07-12 12:59:00 UTC, end at Tue 2022-07-12 13:59:06 UTC. -- Jul 12 13:33:08.395031 dv-cinder-797970-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 13:33:08.403687 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 13:33:08 2022] *** Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: nodename: dv-cinder-797970-4-iscsi Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: machine: x86_64 Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: clock source: unix Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: pcre jit disabled Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: detected number of CPU cores: 4 Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: current working directory: / Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: detected binary path: /usr/bin/uwsgi-core Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: your processes number limit is 47680 Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: your memory page size is 4096 bytes Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: detected max file descriptor number: 2048 Jul 12 13:33:08.405524 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: lock engine: pthread robust mutexes Jul 12 13:33:08.406799 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: thunder lock: enabled Jul 12 13:33:08.406799 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 13:33:08.406799 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 13:33:08.448786 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: Python main interpreter initialized at 0x563cd13979c0 Jul 12 13:33:08.448786 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: python threads support enabled Jul 12 13:33:08.448786 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: your server socket listen backlog is limited to 100 connections Jul 12 13:33:08.448786 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: your mercy for graceful operations on workers is 90 seconds Jul 12 13:33:08.449172 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 13:33:08.449172 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: *** Operational MODE: preforking *** Jul 12 13:33:08.449435 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: *** uWSGI is running in multiple interpreter mode *** Jul 12 13:33:08.449435 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: spawned uWSGI master process (pid: 109943) Jul 12 13:33:08.449631 dv-cinder-797970-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 13:33:08.450778 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: spawned uWSGI worker 1 (pid: 109944, cores: 1) Jul 12 13:33:08.450778 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: spawned uWSGI worker 2 (pid: 109945, cores: 1) Jul 12 13:33:08.450778 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 13:33:09.111980 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:33:09.115944 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:33:10.238752 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:33:10.238752 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: from cryptography.utils import int_from_bytes Jul 12 13:33:10.239442 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:33:10.239442 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: from cryptography.utils import int_from_bytes Jul 12 13:33:10.241380 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:33:10.241380 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: from cryptography.utils import int_from_bytes Jul 12 13:33:10.241805 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:33:10.241805 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: from cryptography.utils import int_from_bytes Jul 12 13:33:12.743329 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:33:12.743960 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:33:12.744097 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:33:12.744456 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:33:12.744709 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:33:12.745092 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.745415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.745735 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.746079 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.746408 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.746720 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.747035 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.747351 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.747675 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.747934 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.748241 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.748559 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-4-iscsi {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.748875 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.748980 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:33:12.749604 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.749692 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:33:12.749772 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.750029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:33:12.750142 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.750352 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.750438 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:33:12.750644 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:33:12.750729 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.750958 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.751052 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.751349 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.751453 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.751675 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.752871 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.753089 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.753276 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.753490 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.754172 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.754367 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.755183 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.755369 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.755529 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.755713 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.755893 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.756107 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.756316 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.756506 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.756700 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.756850 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.757028 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.757241 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-4-iscsi {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.757436 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.757619 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.757619 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.757940 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-4-iscsi {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.758176 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.758375 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.758565 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.758716 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.758866 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.758989 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.759152 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.759292 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.759448 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.759574 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.759696 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.759845 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.759975 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.760104 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.760261 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.760389 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.760389 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.760629 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.760751 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.760872 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.761001 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.761129 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.761264 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.761394 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.761555 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.761680 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.761810 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.761941 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.762081 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.762214 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.762338 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.762460 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.762595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.762718 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-4-iscsi {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.762841 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.762962 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.763093 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.763223 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.763358 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.763482 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.763604 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.763604 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.763847 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.763976 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.764132 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.764280 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.764408 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.764541 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.764666 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.764788 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.764922 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.765053 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.765175 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.765310 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.765442 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.765565 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.765694 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.765799 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.765909 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.766059 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.766166 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.766270 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.766373 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.766475 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.766605 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.766712 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.766712 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.766916 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.767019 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.767139 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.767274 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.767379 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.767379 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.767578 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.767710 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.767834 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.767964 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.768087 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.768215 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.768346 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.768470 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.768605 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.768737 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.768863 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.768992 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.769122 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.769273 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.769921 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.770076 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.770201 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.770322 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.770444 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.770579 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.770703 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.770826 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.770968 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.771098 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.771229 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.771436 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.771562 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.771685 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.771808 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.771936 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.772094 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.772231 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.772421 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.772560 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.772721 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.772849 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.772972 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.773112 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.773258 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.773386 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.773558 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.773734 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.773907 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.774098 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.774222 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.774473 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.774600 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.774723 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.774853 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.775038 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.775648 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.775648 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.775904 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.776036 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.776168 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.776292 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.776421 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.776551 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.776689 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.776812 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.776943 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.777067 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.777197 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.777327 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.777451 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.777573 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.777703 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.777827 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.777983 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.778123 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.778253 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.778433 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.778569 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.778692 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.778848 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.778982 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.779151 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.779291 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.779452 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.779580 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.779752 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.779881 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.780065 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.780202 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.780368 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.780495 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.780670 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.780804 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.780984 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.781124 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.781287 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.781421 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.781589 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.781715 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.781901 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.782095 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.782220 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.782343 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.782517 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.782643 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.782827 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.782967 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.783119 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.783244 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.783425 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.783596 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.783731 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.783844 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.784051 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.784165 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.784364 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.784476 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.784673 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.784795 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.785498 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.785627 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.785807 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.785926 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.786132 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.786245 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.786433 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.786545 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.786733 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.786846 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.787029 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.787142 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.787343 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.787455 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.787647 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.787757 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.787952 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.788063 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.788253 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.788379 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.788554 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.788678 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.788866 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.788991 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.789164 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.789275 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.789473 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.789593 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.789792 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.789903 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.790129 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.790243 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.790441 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.790561 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.790749 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.790862 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.791056 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.791196 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.791365 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.791501 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.791671 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.791797 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.791976 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.792108 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.792283 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.792418 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.792584 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.792711 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.792888 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.793013 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.793200 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.793328 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.793509 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.793787 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.793916 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.794140 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.794280 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.794445 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.794607 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:33:12.794815 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.794941 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.795151 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.795287 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.795486 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.795610 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.795801 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.795928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.796565 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.796701 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.796828 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.796951 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.797178 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.797314 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.797314 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.797558 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.797682 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.797808 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.797937 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.798089 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.798225 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.798350 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.798473 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.798595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.798725 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.798848 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.798980 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.799106 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.799228 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.799350 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.799518 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.799645 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.799841 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.800106 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.800228 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.800405 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.800570 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.801349 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.801498 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.801620 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.801888 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.802084 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.802260 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.802392 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.802698 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.802831 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.803016 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.803362 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.803519 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.803710 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.804029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.804281 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.804408 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.804603 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.804730 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.804928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.805067 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.805245 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.805373 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.805564 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.805690 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.805876 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.806034 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.806216 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.806343 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.806539 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.806860 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.806994 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.807176 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.807494 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.807640 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.807807 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.807949 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.808119 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.808246 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.808431 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.808560 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.808770 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.808919 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.809088 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.809225 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.809405 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.809534 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.809720 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.809862 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.810051 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.810487 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.810682 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.810882 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.811012 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.811275 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.811429 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.811622 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.811749 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.811873 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.812005 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.812255 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.812387 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.812517 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.812648 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.812774 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.812911 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.813042 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.813166 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.813379 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.813662 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.813791 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.814025 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.814342 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.814467 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.814659 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.814796 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.814967 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.815105 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.815291 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.815446 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.815581 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.815706 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.815901 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.816029 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.816235 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.816364 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.816561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.816688 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.817334 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.817462 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.817593 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.817728 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.817853 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.818019 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.818163 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.818288 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.818420 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.818544 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.818670 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.818794 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.818927 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.819061 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.819193 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.819316 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.819446 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.819586 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.819712 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.819835 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.819957 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.820088 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.820220 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.820387 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.820515 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.820687 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.820814 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.820995 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.821149 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.821305 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.821439 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.821576 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.821768 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.821895 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.822120 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.822266 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.822440 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.822568 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.822746 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.822881 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.823060 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.823185 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.823316 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.823439 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.823612 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.823740 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.823942 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.824067 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.824220 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.824347 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.824538 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.824667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.824800 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.824924 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.825100 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.825228 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.825401 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.825536 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.825705 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.825833 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.826048 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.826178 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.826361 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.826503 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.826667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.826795 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.826971 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.827098 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.827277 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.827413 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.827605 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.827730 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.827910 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.828043 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.828216 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.828350 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.828525 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.828651 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.828832 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.828966 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.829149 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.829284 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.829455 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.829590 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.829769 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.829929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.830102 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.830267 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.830403 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.830586 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.830713 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.830902 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.831038 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.831217 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.831331 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.831543 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.831691 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.831885 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.832178 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.832306 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.832508 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.832634 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.832821 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.832949 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.833132 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.833258 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.833437 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.833562 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.833748 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.833874 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.834081 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.834209 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.834390 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.834517 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.834698 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.834833 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.834996 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.835170 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.835298 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.835421 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.835595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.835732 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.835908 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.836036 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.836214 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.836812 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.836955 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.837094 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.837219 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.837342 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.837464 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.837586 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.837709 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.837839 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.837992 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.838118 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.838240 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.838362 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.838484 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.838623 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.838760 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.838884 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.839030 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.839157 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.839350 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.839478 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.839654 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.839778 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.839954 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.840080 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.840262 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.840376 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.843141 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.843293 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.843439 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.843563 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.843681 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.843787 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.843912 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.844019 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.844123 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.844233 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.844351 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.844457 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.844582 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.844706 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.844830 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.844962 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.845085 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.845217 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.845340 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.845463 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.845596 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.845733 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.846419 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.846559 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.846685 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.846808 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.846944 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.847068 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.847190 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.847827 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.847965 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.848089 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.848225 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.848358 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.848482 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.848605 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.848727 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.848858 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.848981 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.849103 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.849237 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.849360 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.849482 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.849617 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.849742 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.849864 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.850024 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.850158 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.850282 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.850405 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.850512 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.850615 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.850725 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.850829 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.850939 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.851057 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.851163 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.851272 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.851377 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.851480 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.851591 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.851696 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.851798 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.851909 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.852013 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.852122 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.852234 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.852339 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.852451 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.852562 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.852674 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.852777 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.852888 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.852997 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.853130 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.853254 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.853376 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.853498 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.853703 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.853831 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.853970 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.854108 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.854233 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.854364 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.854488 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.854610 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.854733 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.854856 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.854977 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.855107 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.855297 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.855460 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.855460 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.855697 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.855697 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.855949 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.856073 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.856195 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.856317 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.856439 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.856439 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.856680 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.857324 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.857455 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.857579 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.857702 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.857702 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.857972 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.858099 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.858236 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.858375 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.858500 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.858622 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.858744 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.858876 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.858983 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.859088 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.859198 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.859303 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.859415 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.859529 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.859641 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.859745 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.859934 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.860242 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.860544 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.860769 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.860910 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.861086 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.861215 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.861402 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.861529 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.861711 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.861846 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.862018 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.862145 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.862330 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.862457 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.862632 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.862761 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.862962 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.863604 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.863792 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.863919 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.864092 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.864219 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.864393 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.864520 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.864694 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.864821 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.865000 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.865138 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.865307 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.865434 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.865630 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.865771 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.865934 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.866080 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.866270 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.866398 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.866578 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.866722 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.866884 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.867018 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.867200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.867328 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.867497 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.867631 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.867796 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.867924 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.868093 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.868222 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.868399 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.868526 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.868703 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.868830 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.869001 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.869137 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.869307 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.869444 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.869610 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.869737 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.869916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.870101 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.870238 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.870364 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.870534 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.870662 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.870838 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.870979 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.871137 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.871266 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.871449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.871577 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.871753 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.871897 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.872051 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.872178 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.872349 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.872477 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.872654 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.872791 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.872956 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.873084 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.873254 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.873382 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.873560 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.873696 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.873857 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.874013 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.874446 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.874574 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.874752 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.874891 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.875070 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.875199 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.875378 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.875682 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.875832 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.876016 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.876147 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.876271 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.876395 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.876646 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.876784 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.876907 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.877040 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.877173 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.877794 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.878071 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.878202 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.878326 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.878457 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.878609 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.878735 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.878868 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.879001 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.879126 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.879249 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.879379 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.879512 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.879643 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.879767 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.879891 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.880014 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.880137 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.880278 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.880410 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.880533 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.880656 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.880779 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.880903 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.881051 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.881217 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.881350 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.881481 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.881604 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.881735 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.881867 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.882011 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.882136 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.882259 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.882394 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.882528 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.882652 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.882804 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.882940 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.883108 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.883249 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.883408 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.883536 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.883705 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.883833 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.884003 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.884139 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.884341 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.884477 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.884641 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.884769 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.884978 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.885105 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.885279 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.885412 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.885585 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.885712 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.885890 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.886058 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.886221 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.886347 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.886534 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.886659 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.886869 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.887008 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.887136 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.887259 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.887421 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.887548 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.887727 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.887864 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.888034 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.888161 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.888334 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.888462 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.888634 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.888770 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.888950 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.889070 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.889256 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.889384 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.889559 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.889700 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.889873 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.890030 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.890212 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.890341 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.890519 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.890712 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.890849 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.890979 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.891104 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.891226 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.891399 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.891532 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.891714 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.891843 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.891990 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.892161 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.892304 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.892430 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.892582 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.892720 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.892888 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.893014 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.893192 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.893321 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.893497 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.893624 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.893800 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.893939 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.894109 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.894255 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.894441 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.894581 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.894747 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.894888 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.895048 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.895183 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.895364 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.895498 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.895668 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.895809 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.895966 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.896094 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.896281 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.896468 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.896586 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.896721 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.896851 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.897044 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.897162 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.897283 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.897540 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.898193 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.898193 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.898454 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.898576 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.898699 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.898833 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.898957 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.898957 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.899178 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.899299 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.899428 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.899559 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.899682 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.899804 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.899925 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.900045 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.900174 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.900306 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.900437 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.900560 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.900681 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.900952 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.901092 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.901254 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.901379 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.901554 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.901681 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.901853 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.902057 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.902185 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.902307 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.902484 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.902608 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.902781 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.902917 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.903079 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.903212 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.903376 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.903509 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.903692 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.903831 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.903991 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.904124 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.904304 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.904439 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.904689 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.904815 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.904994 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.905129 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.905290 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.905416 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.905618 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.905742 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.905915 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.906067 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.906244 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.906371 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.906550 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.906672 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.906856 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.906974 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.907178 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.907307 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.907483 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.907612 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.907799 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.907924 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.908106 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.908243 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.908424 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.908551 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.908742 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.908869 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.909047 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.909188 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.909356 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.909498 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.909655 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.909784 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.910563 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.910693 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.910889 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.911030 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.911201 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.911329 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.911521 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.911648 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.911855 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.911995 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.912168 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.912297 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.912492 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.912628 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.912819 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.912964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.913131 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.913267 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.913446 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.913581 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.913752 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.913890 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.914103 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.914232 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.914427 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.914553 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.914744 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.914871 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.915059 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.915183 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.915360 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.915486 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.915668 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.915795 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.915975 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.916108 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.916284 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.916411 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.916653 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.916804 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.916934 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.917058 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.917181 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.917353 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.917480 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.917668 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.917795 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.918459 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.918606 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.918745 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.918870 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.918992 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.919122 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.919245 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.919358 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.919488 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.919611 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.919741 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.919863 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.919975 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.920095 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.920229 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.920353 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.920475 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.920604 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.920743 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.920875 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.921000 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.921124 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.921299 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.921438 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.921611 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.921798 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.921928 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.922075 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.922285 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.922413 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.922592 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.922732 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.922914 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.923075 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.923230 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.923359 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.923539 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.923675 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.923843 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.923972 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.924148 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.924284 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.924449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.924576 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.924758 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.924893 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.925058 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.925187 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.925358 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.925533 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.926243 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.926380 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.926556 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.926683 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.926856 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.926985 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.927156 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.927290 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.927454 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.927582 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.927769 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.927896 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.928069 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.928196 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.928387 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.928526 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.928693 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.928820 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.928992 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.929120 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.929292 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.929428 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.929590 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.929718 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.929926 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.930082 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.930254 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.930392 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.930584 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.930720 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.930898 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.931025 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.931216 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.931353 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.931541 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.931668 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.931848 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.931983 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.932167 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.932301 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.932478 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.932611 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.932783 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.932917 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.933090 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.933219 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.933395 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.933523 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.933703 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.933828 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.934036 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.934167 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.934349 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.934477 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.934657 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.934793 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.934969 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.935097 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.935278 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.935407 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.935591 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.935727 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.935914 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.936138 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.936267 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.936461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.936589 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.936773 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.936908 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.937082 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.937290 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.937412 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.937536 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.937669 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.937818 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.937997 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.938171 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.938300 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.938487 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.939096 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.939237 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.939363 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.939487 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.939608 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.939740 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.939864 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.939864 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.940092 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.940217 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.940339 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.940497 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.940627 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.940807 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.940948 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.941153 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.941283 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.941464 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.941600 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.941771 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.941899 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.942151 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.942297 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.942463 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.942599 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.942766 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.942893 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.943073 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.943213 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.943383 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.943512 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.943692 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.943821 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.944000 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.944128 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.944304 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.944431 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.944612 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.944739 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.944917 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.945053 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.945223 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.945351 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.945530 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.945658 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.945858 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.946021 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.946158 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.946283 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.946469 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.946613 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.946798 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.946935 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.947114 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.947247 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.947423 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.947551 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.947730 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.947858 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.948040 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.948166 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.948353 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.948552 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.948680 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.948861 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.948997 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.949187 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.949324 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.949506 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.949634 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.949826 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.949974 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.950177 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.950322 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.950493 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.950630 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.950815 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.950951 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.951118 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.951263 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.951418 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.951546 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.951723 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.951850 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.952027 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.952246 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.952374 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.952568 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.952695 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.952903 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.953040 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.953210 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.953336 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.953525 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.953652 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.953830 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.954011 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.954184 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.954384 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.954513 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.954732 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.954872 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.955047 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.955184 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.955370 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.955505 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.955692 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.955834 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.955999 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.956127 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.956303 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.956430 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.956623 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.956779 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.956954 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.957080 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.957254 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.957381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.957567 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.957703 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.957873 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.958124 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.958255 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.958474 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.958602 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.958786 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.958968 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.959096 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.959220 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.959374 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.959512 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.959680 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.959808 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.959981 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.960116 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.960302 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.960442 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.960603 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.960764 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.960891 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.961024 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.961192 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.961329 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.961500 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.961629 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.961804 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.961938 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.962143 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.962283 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.962442 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.962568 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.962740 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.962868 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.963047 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.963173 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.963344 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.963470 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.963648 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.963776 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.963947 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.964075 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.964254 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.964777 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.964916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.965041 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.965176 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.965300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.965300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.965549 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.965674 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.965798 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.965930 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.966093 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.966217 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.966341 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.966463 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.966621 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.966748 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.966880 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.967004 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.967127 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.967257 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.967391 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.967522 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.967635 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.967816 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.967945 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.968122 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.968260 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.968432 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.968690 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.968818 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.969017 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.969153 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.969334 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.969462 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.969663 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.969791 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.969996 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.970139 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.970303 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.970440 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.970603 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.970740 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.970906 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.971050 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.971219 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.971345 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.971525 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.971652 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.971832 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.971974 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.972139 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.972914 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.973050 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.973251 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.973379 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.973554 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.973680 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.973862 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.974007 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.974196 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.974335 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.974502 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.974637 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.974808 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.974936 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.975113 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.975318 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.975445 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.975568 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.975692 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.975821 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.976006 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.976143 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.976337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.976463 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.976648 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.976781 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.976959 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.977092 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.977269 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.977395 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.977576 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.977694 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.977878 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.978023 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.978209 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.978337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.978515 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.978652 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.978822 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.978951 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.979130 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.979256 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.979443 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.979580 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.979747 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.979874 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.980049 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.980183 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.980392 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.980531 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.980712 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.980840 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.981031 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.981166 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.981349 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.981497 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.981657 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.981784 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.982009 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.982139 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.982277 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.982403 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.982592 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.982722 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.982906 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.983032 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.983213 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.983349 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.983534 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.983661 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.983842 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.983970 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.984170 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.984304 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.984487 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.984614 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.984789 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.984926 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.985089 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.985225 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.985386 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.985514 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.985696 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.985832 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.986031 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.986161 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.986339 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.986466 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.986638 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.986779 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.986934 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.987072 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.987267 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.987400 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.987513 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.987683 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.987813 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.988067 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.988198 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.988395 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.988533 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.988703 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.988832 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.989452 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.989579 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.989705 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.989839 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.990029 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.990157 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.990281 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.990417 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.990417 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.990662 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.990662 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.990912 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.991038 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.991162 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.991294 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.991419 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.991550 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.991674 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.991798 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.991921 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.992059 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.992184 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.992308 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.992439 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.992563 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.992695 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.992828 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.992952 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.993136 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.993263 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.993513 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.993664 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.993804 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.993928 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.994087 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.994219 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.994350 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.994482 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.994662 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.994815 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.994968 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.995103 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.995273 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.995409 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.995576 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.995701 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.995880 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.996007 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.996184 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.996321 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.996494 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.996619 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.996800 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.996927 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.997106 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.997242 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.997411 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.997545 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.997719 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.997845 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.998066 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.998208 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.998380 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.998505 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.998680 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.998804 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.999009 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.999432 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.999558 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.999683 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:12.999873 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.000003 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.000184 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.000311 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.000491 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.000620 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.001252 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.001398 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.001527 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.001651 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.001651 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.001883 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.002026 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.002166 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.002292 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.002416 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.002548 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.002673 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.002796 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.002928 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.003053 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.003176 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.003299 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.003422 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.004051 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.004257 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.004384 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.004509 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.004633 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.004765 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.004925 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.005055 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.005268 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.005396 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.005578 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.005707 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.005895 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.006069 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.006238 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.006369 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.006550 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.006686 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.006859 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.006987 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.007159 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.007294 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.007401 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109945) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:33:13.007515 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.007792 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.008118 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.008431 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.008759 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.009090 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.009461 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.009780 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.010158 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.010494 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.011106 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.011106 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.011405 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:33:13.011650 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109944) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:33:13.068673 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO dbcounter [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Registered counter for database nova_api Jul 12 13:33:13.073795 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO dbcounter [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Registered counter for database nova_api Jul 12 13:33:13.188861 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG oslo_db.sqlalchemy.engines [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:33:13.190545 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_db.sqlalchemy.engines [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:33:13.196306 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG dbcounter [-] [109944] Writer thread running {{(pid=109944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:33:13.197859 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writer thread running {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:33:13.253472 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.context [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c4e355e-53a6-4660-8086-68fb4f4fbe3f(cell1) {{(pid=109945) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:33:13.254376 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.context [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c4e355e-53a6-4660-8086-68fb4f4fbe3f(cell1) {{(pid=109944) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:33:13.258126 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:13.258308 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG oslo_concurrency.lockutils [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:13.259673 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:13.259891 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG oslo_concurrency.lockutils [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:13.260456 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:13.260686 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG oslo_concurrency.lockutils [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:33:13.262570 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:13.262823 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG oslo_concurrency.lockutils [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109944) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:33:13.264520 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO dbcounter [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Registered counter for database nova_cell0 Jul 12 13:33:13.264790 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO dbcounter [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Registered counter for database nova_cell0 Jul 12 13:33:13.268520 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO dbcounter [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Registered counter for database nova_cell1 Jul 12 13:33:13.268888 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO dbcounter [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Registered counter for database nova_cell1 Jul 12 13:33:13.276063 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_db.sqlalchemy.engines [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:33:13.278279 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_db.sqlalchemy.engines [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:33:13.279915 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG oslo_db.sqlalchemy.engines [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:33:13.283026 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writer thread running {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:33:13.283723 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG oslo_db.sqlalchemy.engines [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:33:13.287362 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG dbcounter [-] [109944] Writer thread running {{(pid=109944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:33:13.288497 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writer thread running {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:33:13.434250 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO dbcounter [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Registered counter for database nova_cell0 Jul 12 13:33:13.438445 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG dbcounter [-] [109944] Writer thread running {{(pid=109944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:33:13.445884 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_db.sqlalchemy.engines [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109945) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:33:13.450632 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writer thread running {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:33:13.453660 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO dbcounter [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Registered counter for database nova_cell0 Jul 12 13:33:13.463691 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG oslo_db.sqlalchemy.engines [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109944) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:33:13.468107 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG dbcounter [-] [109944] Writer thread running {{(pid=109944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:33:13.788088 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: WARNING keystonemiddleware.auth_token [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:33:13.788654 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: WARNING keystonemiddleware.auth_token [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:33:13.795751 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: WARNING keystonemiddleware.auth_token [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:33:13.795917 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: WARNING keystonemiddleware.auth_token [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:33:14.132929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: WARNING keystonemiddleware.auth_token [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:33:14.133181 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: WARNING keystonemiddleware.auth_token [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:33:14.138882 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: WARNING keystonemiddleware.auth_token [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:33:14.139012 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: WARNING keystonemiddleware.auth_token [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:33:14.144607 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563cd13979c0 pid: 109944 (default app) Jul 12 13:33:14.144718 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563cd13979c0 pid: 109945 (default app) Jul 12 13:33:14.146721 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:33:14.147914 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-6093f6e7-1d26-42d9-92fb-42656b91ada0 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001784 Jul 12 13:33:14.148336 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Tue Jul 12 13:33:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:30.992474 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:30.993691 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Jul 12 13:34:30.994120 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:34:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:31.006480 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG dbcounter [-] [109944] Writing DB stats nova_api:SELECT=3 {{(pid=109944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:31.007613 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG dbcounter [-] [109944] Writing DB stats nova_cell0:SELECT=3 {{(pid=109944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:31.008483 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG dbcounter [-] [109944] Writing DB stats nova_cell1:SELECT=3 {{(pid=109944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:31.009450 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG dbcounter [-] [109944] Writing DB stats nova_cell0:SELECT=3 {{(pid=109944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:31.935619 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-48278810-91a0-4e91-9bb6-5e8d1edc69a1 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:31.967066 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-48278810-91a0-4e91-9bb6-5e8d1edc69a1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.966339 Jul 12 13:34:31.967820 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jul 12 13:34:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:34.231964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:34.234238 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-d365cebe-9661-4fbc-a8fa-6dab29552746 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Jul 12 13:34:34.235905 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 2/4] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:34:34 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:34.702297 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-c31a9c0a-5969-4bd7-a2a1-d8e33a14ac54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "id": "c1", "ram": 256}} {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:34.721040 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:34:34.721040 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: warnings.warn(msg) Jul 12 13:34:34.752493 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-c31a9c0a-5969-4bd7-a2a1-d8e33a14ac54 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.510784 Jul 12 13:34:34.753157 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 3/5] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jul 12 13:34:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:34:34.770002 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writing DB stats nova_api:SELECT=3 {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:34.771360 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writing DB stats nova_cell1:SELECT=3 {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:34.772092 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writing DB stats nova_cell0:SELECT=3 {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:34.773042 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:34.997158 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-5867b9ee-7424-428a-8a52-aad0febbb70b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:34.999896 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:34:34.999896 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: warnings.warn(msg) Jul 12 13:34:35.067249 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-5867b9ee-7424-428a-8a52-aad0febbb70b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.306135 Jul 12 13:34:35.068058 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 3/6] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jul 12 13:34:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:34:37.318937 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-c31a9c0a-5969-4bd7-a2a1-d8e33a14ac54 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:37.320043 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-c31a9c0a-5969-4bd7-a2a1-d8e33a14ac54 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 12 13:34:37.320513 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 4/7] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:34:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:38.075691 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-847a6ad5-f223-4224-9b27-9020cb11b829 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:38.095894 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:34:38.095894 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: warnings.warn(msg) Jul 12 13:34:38.117351 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-847a6ad5-f223-4224-9b27-9020cb11b829 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.790593 Jul 12 13:34:38.125267 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 4/8] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jul 12 13:34:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:34:38.131040 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-715b7bea-c5b8-4063-a7fe-bf2ae4a727cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:38.132548 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:34:38.132548 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: warnings.warn(msg) Jul 12 13:34:38.168179 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-715b7bea-c5b8-4063-a7fe-bf2ae4a727cd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041025 Jul 12 13:34:38.168945 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 5/9] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jul 12 13:34:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:40.437939 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-847a6ad5-f223-4224-9b27-9020cb11b829 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:40.439040 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-847a6ad5-f223-4224-9b27-9020cb11b829 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jul 12 13:34:40.439445 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:34:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:40.849269 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-7f450a84-c9d3-49b4-b4c9-8235d002ced1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10}} {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:40.868218 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-7f450a84-c9d3-49b4-b4c9-8235d002ced1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422761 Jul 12 13:34:40.868694 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 6/11] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jul 12 13:34:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:34:40.881188 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-bd4253cd-b372-4e07-a9ab-4d0041ce1307 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:40.903876 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-bd4253cd-b372-4e07-a9ab-4d0041ce1307 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026277 Jul 12 13:34:40.904448 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 6/12] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jul 12 13:34:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:43.133276 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-7f450a84-c9d3-49b4-b4c9-8235d002ced1 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:43.134402 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-7f450a84-c9d3-49b4-b4c9-8235d002ced1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 12 13:34:43.135219 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 7/13] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:34:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:43.577111 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-6004f29d-a81f-4036-8008-850658abadf3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:43.612699 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-6004f29d-a81f-4036-8008-850658abadf3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461624 Jul 12 13:34:43.613616 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 7/14] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jul 12 13:34:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:34:43.629060 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-68af5e69-e33a-4f59-ba96-4da81a4e3ccf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:43.659471 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-68af5e69-e33a-4f59-ba96-4da81a4e3ccf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035999 Jul 12 13:34:43.662609 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 8/15] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jul 12 13:34:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:45.965498 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-6004f29d-a81f-4036-8008-850658abadf3 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:45.966533 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-6004f29d-a81f-4036-8008-850658abadf3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jul 12 13:34:45.966931 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 8/16] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:34:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:46.467590 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-6b499c5f-44f2-47c9-b03c-e48c2aa749ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "disk": 20, "swap": 0, "ram": 4096, "vcpus": 4}} {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:46.492893 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-6b499c5f-44f2-47c9-b03c-e48c2aa749ac admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519140 Jul 12 13:34:46.493703 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 9/17] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jul 12 13:34:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:34:46.509867 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-6bdf0460-13da-4670-8cce-8f986e6aa6d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:46.540619 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-6bdf0460-13da-4670-8cce-8f986e6aa6d5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034270 Jul 12 13:34:46.551211 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 9/18] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Jul 12 13:34:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:48.807867 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-6b499c5f-44f2-47c9-b03c-e48c2aa749ac admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:48.809648 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-6b499c5f-44f2-47c9-b03c-e48c2aa749ac admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002371 Jul 12 13:34:48.810369 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 10/19] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:34:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:49.230287 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-53ce1777-6968-43df-8db7-8fb9f3e98d42 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:49.254925 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-53ce1777-6968-43df-8db7-8fb9f3e98d42 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.435888 Jul 12 13:34:49.255502 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jul 12 13:34:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:34:51.682506 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-6b499c5f-44f2-47c9-b03c-e48c2aa749ac admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:51.683650 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-6b499c5f-44f2-47c9-b03c-e48c2aa749ac admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001952 Jul 12 13:34:51.684223 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 11/21] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:34:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:52.115118 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-22a2b6c6-ef4e-4263-b788-0e3d3443bb9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:52.134347 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-22a2b6c6-ef4e-4263-b788-0e3d3443bb9d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.442064 Jul 12 13:34:52.135193 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 11/22] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jul 12 13:34:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:34:52.150859 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-5bf2dcdc-d310-41eb-85b4-2acb4ba090f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:52.179644 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-5bf2dcdc-d310-41eb-85b4-2acb4ba090f6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033494 Jul 12 13:34:52.180722 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 12/23] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jul 12 13:34:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:54.529534 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-22a2b6c6-ef4e-4263-b788-0e3d3443bb9d admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:54.530732 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-22a2b6c6-ef4e-4263-b788-0e3d3443bb9d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Jul 12 13:34:54.531089 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:34:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:54.943912 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-9cd98dd8-81b6-477f-856f-4cfeffd0e4f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "disk": 20, "swap": 0, "vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:54.961942 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-9cd98dd8-81b6-477f-856f-4cfeffd0e4f1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423524 Jul 12 13:34:54.962450 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 13/25] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jul 12 13:34:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:34:54.974176 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-0594a92b-7eae-4813-90f8-38a77a6fc21d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:54.996595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-0594a92b-7eae-4813-90f8-38a77a6fc21d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026176 Jul 12 13:34:54.997175 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 13/26] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jul 12 13:34:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:34:57.232429 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-9cd98dd8-81b6-477f-856f-4cfeffd0e4f1 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:34:57.233602 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-9cd98dd8-81b6-477f-856f-4cfeffd0e4f1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Jul 12 13:34:57.234157 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:34:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:34:57.653294 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-e4a7ef89-b670-44ad-b4b4-a635236a893b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0, "id": "3", "vcpus": 2}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:57.673282 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-e4a7ef89-b670-44ad-b4b4-a635236a893b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.432285 Jul 12 13:34:57.674058 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jul 12 13:34:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:34:57.686205 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-696b3563-afd1-4030-b7cc-b924e7702eee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:34:57.714571 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-696b3563-afd1-4030-b7cc-b924e7702eee admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032084 Jul 12 13:34:57.715798 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 15/29] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jul 12 13:34:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:00.061125 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-e4a7ef89-b670-44ad-b4b4-a635236a893b admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:00.062089 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-e4a7ef89-b670-44ad-b4b4-a635236a893b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 12 13:35:00.063461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:35:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:00.515207 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-e1d10c85-057d-4000-b439-871db2b8739f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "id": "4", "vcpus": 4}} {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:00.537054 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-e1d10c85-057d-4000-b439-871db2b8739f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466140 Jul 12 13:35:00.549246 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jul 12 13:35:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:35:00.621220 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-d83a5883-a747-4328-9899-9a749fd5fbfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:00.654589 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-d83a5883-a747-4328-9899-9a749fd5fbfb admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043017 Jul 12 13:35:00.655467 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 16/32] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jul 12 13:35:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:02.938506 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-e1d10c85-057d-4000-b439-871db2b8739f admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:02.941110 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-e1d10c85-057d-4000-b439-871db2b8739f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003690 Jul 12 13:35:02.946392 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:35:02 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:03.400744 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-0af4a4a6-5b80-4329-a3c9-8eb1e49f772b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:03.418794 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-0af4a4a6-5b80-4329-a3c9-8eb1e49f772b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471016 Jul 12 13:35:03.419626 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 17/34] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Jul 12 13:35:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:35:03.434021 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-e55f4073-4638-488b-a656-a5d8b39eff5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:03.438083 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG dbcounter [-] [109944] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:03.460320 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-e55f4073-4638-488b-a656-a5d8b39eff5b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032414 Jul 12 13:35:03.461345 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 18/35] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Jul 12 13:35:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:35:23.384479 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-0af4a4a6-5b80-4329-a3c9-8eb1e49f772b admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:23.385515 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-0af4a4a6-5b80-4329-a3c9-8eb1e49f772b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 12 13:35:23.385916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 18/36] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:23.775344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-2dbd1e31-fbf2-4ccd-86a0-b53510090059 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:23.792648 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-2dbd1e31-fbf2-4ccd-86a0-b53510090059 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400959 Jul 12 13:35:23.793189 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jul 12 13:35:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:35:24.853143 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-0af4a4a6-5b80-4329-a3c9-8eb1e49f772b admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:24.854187 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-0af4a4a6-5b80-4329-a3c9-8eb1e49f772b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 12 13:35:24.854588 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 19/38] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:35:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:25.379252 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-0cde696b-4290-4bc0-bc65-0f6dc1460c20 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:25.384805 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.wsgi [None req-0cde696b-4290-4bc0-bc65-0f6dc1460c20 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-0cde696b-4290-4bc0-bc65-0f6dc1460c20 admin admin] Request method failure captured: Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Accept: application/json Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Accept-Encoding: gzip, deflate Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Connection: keep-alive Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Content-Length: 0 Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Host: 10.222.0.52 Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Openstack-Api-Version: compute 2.90 Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Openstack-System-Scope: None Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: User-Agent: python-novaclient Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Auth-Token: gAAAAABizXicE7eOW2IoFTjSq5uzwjxRTxgvoil64i9aog9uB_Oe07MBH1c0UGpDPKMeayejcwPfL5WONXmQ3zRJ4_Bo5lxpeM8MR1z-NKdbpC5QOjW-Y_k2LDUpsc-nlW5MLzmXyxM7yUAFnslItR4LHlcxGu_-dRlPhXbIXZ2ILiBTO_4DzpI Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Domain-Id: None Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Domain-Name: None Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Identity-Status: Confirmed Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Is-Admin-Project: True Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Domain-Id: default Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Domain-Name: Default Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Name: admin Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Role: member,reader,admin Jul 12 13:35:25.388065 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Roles: member,reader,admin Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Tenant: admin Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Tenant-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Tenant-Name: admin Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User: admin Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Domain-Id: default Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Domain-Name: Default Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Id: 0ed92bd32dc24cfabfcf0a70a4518dcf Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Name: admin Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: method: > Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: exception: Flavor 42 could not be found. Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: action_args: {'id': '42'} Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:35:25.389667 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:25.391337 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:25.393381 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-0cde696b-4290-4bc0-bc65-0f6dc1460c20 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:35:25.395389 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-0cde696b-4290-4bc0-bc65-0f6dc1460c20 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395917 Jul 12 13:35:25.395389 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jul 12 13:35:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:35:25.399697 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-3438b116-6515-4b80-878b-5b3b43557574 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:25.402686 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:25.422469 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-3438b116-6515-4b80-878b-5b3b43557574 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026285 Jul 12 13:35:25.423024 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jul 12 13:35:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:35:25.432677 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-2fb2d98d-a484-4dc6-9541-5964f2180eae admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:25.454181 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-2fb2d98d-a484-4dc6-9541-5964f2180eae admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025008 Jul 12 13:35:25.454709 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jul 12 13:35:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:35:25.463825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-75ad3d17-e64a-4f2b-a316-a872cdd7d20a admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:25.470755 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.wsgi [None req-75ad3d17-e64a-4f2b-a316-a872cdd7d20a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-75ad3d17-e64a-4f2b-a316-a872cdd7d20a admin admin] Request method failure captured: Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Accept: application/json Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Accept-Encoding: gzip, deflate Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Connection: keep-alive Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Content-Length: 0 Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Host: 10.222.0.52 Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Openstack-Api-Version: compute 2.90 Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Openstack-System-Scope: None Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: User-Agent: python-novaclient Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Auth-Token: gAAAAABizXicE7eOW2IoFTjSq5uzwjxRTxgvoil64i9aog9uB_Oe07MBH1c0UGpDPKMeayejcwPfL5WONXmQ3zRJ4_Bo5lxpeM8MR1z-NKdbpC5QOjW-Y_k2LDUpsc-nlW5MLzmXyxM7yUAFnslItR4LHlcxGu_-dRlPhXbIXZ2ILiBTO_4DzpI Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Domain-Id: None Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Domain-Name: None Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Identity-Status: Confirmed Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Is-Admin-Project: True Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Domain-Id: default Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Domain-Name: Default Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Name: admin Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Role: member,reader,admin Jul 12 13:35:25.473979 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Roles: member,reader,admin Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Tenant: admin Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Tenant-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Tenant-Name: admin Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User: admin Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Domain-Id: default Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Domain-Name: Default Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Id: 0ed92bd32dc24cfabfcf0a70a4518dcf Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Name: admin Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: method: > Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: exception: Flavor 42 could not be found. Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: action_args: {'id': '42'} Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:35:25.475461 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:25.476483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:25.477928 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-75ad3d17-e64a-4f2b-a316-a872cdd7d20a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:35:25.479210 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-75ad3d17-e64a-4f2b-a316-a872cdd7d20a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015047 Jul 12 13:35:25.479210 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 21/42] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jul 12 13:35:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 13:35:26.435910 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-2fb2d98d-a484-4dc6-9541-5964f2180eae admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:26.436918 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-2fb2d98d-a484-4dc6-9541-5964f2180eae admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 12 13:35:26.437320 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 22/43] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:35:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:26.963577 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-8c9d517d-d146-4b16-9fdf-a47df6805313 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:26.970097 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.wsgi [None req-8c9d517d-d146-4b16-9fdf-a47df6805313 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-8c9d517d-d146-4b16-9fdf-a47df6805313 admin admin] Request method failure captured: Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Accept: application/json Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Accept-Encoding: gzip, deflate Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Connection: keep-alive Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Content-Length: 0 Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Host: 10.222.0.52 Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Openstack-Api-Version: compute 2.90 Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Openstack-System-Scope: None Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: User-Agent: python-novaclient Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Auth-Token: gAAAAABizXieqpgtJSry6p6grxjn0WHR77rAZdjJvNmp87UDjONejfPnP1O3fmukECXBFUOFk4UnhuJ73Qnzvg6DhVY2GhyvtTVcjlhe2hWBJtjxj--dJVKIP8Yk8_1esMHu7q_W4y4XTGXY9YEQOllguCQ_UUV1l90smq8GWPaNjZCk3S9fwRU Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Domain-Id: None Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Domain-Name: None Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Identity-Status: Confirmed Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Is-Admin-Project: True Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Domain-Id: default Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Domain-Name: Default Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Name: admin Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Role: member,reader,admin Jul 12 13:35:26.971916 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Roles: member,reader,admin Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Tenant: admin Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Tenant-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Tenant-Name: admin Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User: admin Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Domain-Id: default Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Domain-Name: Default Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Id: 0ed92bd32dc24cfabfcf0a70a4518dcf Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Name: admin Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: method: > Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: exception: Flavor 84 could not be found. Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: action_args: {'id': '84'} Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:35:26.973449 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:26.974595 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:26.975964 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-8c9d517d-d146-4b16-9fdf-a47df6805313 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:35:26.977225 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-8c9d517d-d146-4b16-9fdf-a47df6805313 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396408 Jul 12 13:35:26.977225 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jul 12 13:35:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:35:26.983329 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-0e7c92bf-54e0-4348-bcdb-535eddf21ec6 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:26.997001 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-0e7c92bf-54e0-4348-bcdb-535eddf21ec6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017715 Jul 12 13:35:26.997547 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jul 12 13:35:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:35:27.008131 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-b1e82c72-4085-4df9-b3db-1867b8cbcf26 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:27.022404 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-b1e82c72-4085-4df9-b3db-1867b8cbcf26 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017967 Jul 12 13:35:27.022944 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jul 12 13:35:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:35:27.032377 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-566d818c-a850-4a98-a4d4-81f8a9b7cf3b admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:27.037820 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.wsgi [None req-566d818c-a850-4a98-a4d4-81f8a9b7cf3b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-566d818c-a850-4a98-a4d4-81f8a9b7cf3b admin admin] Request method failure captured: Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Accept: application/json Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Accept-Encoding: gzip, deflate Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Connection: keep-alive Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Content-Length: 0 Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Host: 10.222.0.52 Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Openstack-Api-Version: compute 2.90 Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Openstack-System-Scope: None Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: User-Agent: python-novaclient Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Auth-Token: gAAAAABizXieqpgtJSry6p6grxjn0WHR77rAZdjJvNmp87UDjONejfPnP1O3fmukECXBFUOFk4UnhuJ73Qnzvg6DhVY2GhyvtTVcjlhe2hWBJtjxj--dJVKIP8Yk8_1esMHu7q_W4y4XTGXY9YEQOllguCQ_UUV1l90smq8GWPaNjZCk3S9fwRU Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Domain-Id: None Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Domain-Name: None Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Identity-Status: Confirmed Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Is-Admin-Project: True Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Domain-Id: default Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Domain-Name: Default Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Name: admin Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Role: member,reader,admin Jul 12 13:35:27.039368 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Roles: member,reader,admin Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Tenant: admin Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Tenant-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Tenant-Name: admin Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User: admin Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Domain-Id: default Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Domain-Name: Default Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Id: 0ed92bd32dc24cfabfcf0a70a4518dcf Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Name: admin Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: method: > Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: exception: Flavor 84 could not be found. Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: action_args: {'id': '84'} Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:35:27.041200 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:27.042029 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:27.043087 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-566d818c-a850-4a98-a4d4-81f8a9b7cf3b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:35:27.044063 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-566d818c-a850-4a98-a4d4-81f8a9b7cf3b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011937 Jul 12 13:35:27.044063 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Jul 12 13:35:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 13:35:28.010041 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-b1e82c72-4085-4df9-b3db-1867b8cbcf26 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:28.011066 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-b1e82c72-4085-4df9-b3db-1867b8cbcf26 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Jul 12 13:35:28.011463 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 24/48] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:35:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:28.528407 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-46ed793e-320c-493a-90ec-514c2679825f admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:28.534787 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.wsgi [None req-46ed793e-320c-493a-90ec-514c2679825f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-46ed793e-320c-493a-90ec-514c2679825f admin admin] Request method failure captured: Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Accept: application/json Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Accept-Encoding: gzip, deflate Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Connection: keep-alive Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Content-Length: 0 Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Host: 10.222.0.52 Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Openstack-Api-Version: compute 2.90 Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Openstack-System-Scope: None Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: User-Agent: python-novaclient Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Auth-Token: gAAAAABizXifU4PQa78x6vcmEkDY4a5uXh5NNQE4KfMpaLjHTcrmrPZNXistSjffGY4L_ZtxbAZtzUFL1e0wHAw70k5orhRZDY4S05Y81ydICG2aNPJQef21RpKiNlY1dmMDkKm4zj4_nmSFHP8SLXamJYA4hlc6KbdFjKLtXqHQrffVA4R_uIY Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Domain-Id: None Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Domain-Name: None Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Identity-Status: Confirmed Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Is-Admin-Project: True Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Domain-Id: default Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Domain-Name: Default Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Project-Name: admin Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Role: member,reader,admin Jul 12 13:35:28.536300 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Roles: member,reader,admin Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Tenant: admin Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Tenant-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-Tenant-Name: admin Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User: admin Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Domain-Id: default Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Domain-Name: Default Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Id: 0ed92bd32dc24cfabfcf0a70a4518dcf Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: X-User-Name: admin Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: method: > Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: exception: Flavor 451 could not be found. Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: action_args: {'id': '451'} Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:35:28.538344 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:28.539561 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: ERROR nova.api.openstack.wsgi Jul 12 13:35:28.540929 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-46ed793e-320c-493a-90ec-514c2679825f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109944) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:35:28.542216 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-46ed793e-320c-493a-90ec-514c2679825f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389114 Jul 12 13:35:28.542216 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 25/49] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jul 12 13:35:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:35:28.548276 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-8c780364-62e4-4250-8c2a-bc3dc504eee8 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:28.561729 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-8c780364-62e4-4250-8c2a-bc3dc504eee8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017621 Jul 12 13:35:28.562292 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 25/50] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jul 12 13:35:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:35:28.572901 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:28.586668 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018585 Jul 12 13:35:28.587202 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 26/51] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Jul 12 13:35:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:35:28.597024 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-1a566c7e-9912-4cda-8673-6a9ce43b2216 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:28.602331 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.wsgi [None req-1a566c7e-9912-4cda-8673-6a9ce43b2216 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-1a566c7e-9912-4cda-8673-6a9ce43b2216 admin admin] Request method failure captured: Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Accept: application/json Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Accept-Encoding: gzip, deflate Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Connection: keep-alive Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Content-Length: 0 Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Host: 10.222.0.52 Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Openstack-Api-Version: compute 2.90 Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Openstack-System-Scope: None Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: User-Agent: python-novaclient Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Auth-Token: gAAAAABizXifU4PQa78x6vcmEkDY4a5uXh5NNQE4KfMpaLjHTcrmrPZNXistSjffGY4L_ZtxbAZtzUFL1e0wHAw70k5orhRZDY4S05Y81ydICG2aNPJQef21RpKiNlY1dmMDkKm4zj4_nmSFHP8SLXamJYA4hlc6KbdFjKLtXqHQrffVA4R_uIY Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Domain-Id: None Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Domain-Name: None Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Identity-Status: Confirmed Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Is-Admin-Project: True Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Domain-Id: default Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Domain-Name: Default Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Project-Name: admin Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Role: member,reader,admin Jul 12 13:35:28.603825 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Roles: member,reader,admin Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8e45bcca33094251b8a3ed60293c2eb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Tenant: admin Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Tenant-Id: 8e45bcca33094251b8a3ed60293c2eb5 Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-Tenant-Name: admin Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User: admin Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Domain-Id: default Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Domain-Name: Default Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Id: 0ed92bd32dc24cfabfcf0a70a4518dcf Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: X-User-Name: admin Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: method: > Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: exception: Flavor 451 could not be found. Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: action_args: {'id': '451'} Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:35:28.605483 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:28.606355 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: ERROR nova.api.openstack.wsgi Jul 12 13:35:28.607415 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-1a566c7e-9912-4cda-8673-6a9ce43b2216 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109945) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:35:28.608442 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-1a566c7e-9912-4cda-8673-6a9ce43b2216 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012251 Jul 12 13:35:28.608442 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 26/52] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jul 12 13:35:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 13:35:29.573257 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:29.574345 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 12 13:35:29.574766 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:35:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:30.104568 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-59165ef1-01db-4a76-bdb6-128d1989b9b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:30.122306 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-59165ef1-01db-4a76-bdb6-128d1989b9b6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.408660 Jul 12 13:35:30.122861 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 27/54] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jul 12 13:35:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:35:31.091215 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:31.092251 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 12 13:35:31.092656 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:35:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:31.628130 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-e78c66df-8d93-41d4-a25a-592c59d2476f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:31.644770 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-e78c66df-8d93-41d4-a25a-592c59d2476f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408951 Jul 12 13:35:31.645312 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 28/56] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jul 12 13:35:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:35:32.618972 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:32.619998 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 12 13:35:32.620401 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:33.150478 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-c4e0e44d-f81b-4341-ada6-30b6033bad2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:33.167606 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-c4e0e44d-f81b-4341-ada6-30b6033bad2e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407491 Jul 12 13:35:33.168155 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 29/58] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jul 12 13:35:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:35:34.134862 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:34.135884 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 12 13:35:34.136287 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 30/59] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:35:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:34.656325 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-c5dcdc67-e95f-4244-834d-7c40b7980764 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:35:34.676977 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-c5dcdc67-e95f-4244-834d-7c40b7980764 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.404199 Jul 12 13:35:34.677540 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 30/60] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Jul 12 13:35:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:35:35.650133 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:35.651144 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 12 13:35:35.651547 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 31/61] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:35:36.175043 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-57b1b222-9f3b-4fca-bcba-86c1d42d42ad admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:35:36.193606 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-57b1b222-9f3b-4fca-bcba-86c1d42d42ad admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404339 Jul 12 13:35:36.194161 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 31/62] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Jul 12 13:35:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:36:28.166634 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:28.167648 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-1bb73c23-724e-47a6-aeca-8e70815a8627 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 12 13:36:28.168055 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 930 bytes} [Tue Jul 12 13:36:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:36:28.178795 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:28.553479 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-2fac2432-8ca3-4b96-86f1-d31582056e9c admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:28.572222 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-2fac2432-8ca3-4b96-86f1-d31582056e9c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397840 Jul 12 13:36:28.572765 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 32/64] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Jul 12 13:36:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:36:28.593801 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG dbcounter [-] [109944] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109944) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:36:28.597808 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-d238feb0-c663-492f-ad7f-e4be6a846859 admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:28.606034 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-d238feb0-c663-492f-ad7f-e4be6a846859 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014103 Jul 12 13:36:28.606559 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 33/65] 10.222.0.52 () {60 vars in 1282 bytes} [Tue Jul 12 13:36:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:28.618282 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-6ed88ec7-4945-4781-af96-7766e978b236 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:28.626073 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-6ed88ec7-4945-4781-af96-7766e978b236 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011285 Jul 12 13:36:28.626582 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 33/66] 10.222.0.52 () {60 vars in 1285 bytes} [Tue Jul 12 13:36:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:36:28.637575 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-9658aa2e-cd03-47e0-acda-cfa4239dc0aa admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:28.645845 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-9658aa2e-cd03-47e0-acda-cfa4239dc0aa admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011648 Jul 12 13:36:28.646401 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 34/67] 10.222.0.52 () {60 vars in 1285 bytes} [Tue Jul 12 13:36:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:36:28.657837 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-86333843-14f9-4726-9c68-06a3b29b3435 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:36:28.665128 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-86333843-14f9-4726-9c68-06a3b29b3435 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011266 Jul 12 13:36:28.665642 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 34/68] 10.222.0.52 () {60 vars in 1282 bytes} [Tue Jul 12 13:36:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:39:51.831286 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-9658aa2e-cd03-47e0-acda-cfa4239dc0aa admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:39:51.832301 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-9658aa2e-cd03-47e0-acda-cfa4239dc0aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001761 Jul 12 13:39:51.832718 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 35/69] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:39:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:39:51.973370 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writing DB stats nova_api:SELECT=6 {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:39:52.137298 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-030a62cf-6289-4a66-9559-45a11415e671 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:39:52.138510 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:39:52.138510 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: warnings.warn(msg) Jul 12 13:39:52.139755 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-030a62cf-6289-4a66-9559-45a11415e671 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:39:52.140217 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-030a62cf-6289-4a66-9559-45a11415e671 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:39:52.141036 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-030a62cf-6289-4a66-9559-45a11415e671 admin admin] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:39:52.141459 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-030a62cf-6289-4a66-9559-45a11415e671 admin admin] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:39:52.174679 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-030a62cf-6289-4a66-9559-45a11415e671 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.202866 Jul 12 13:39:52.175257 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 35/70] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jul 12 13:39:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:39:53.023063 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-9658aa2e-cd03-47e0-acda-cfa4239dc0aa admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:39:53.024140 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-9658aa2e-cd03-47e0-acda-cfa4239dc0aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 12 13:39:53.024606 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:39:53.220018 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-695ff0f6-f8b2-4cd7-9b75-3d0fcce17d4f admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:39:53.221187 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:39:53.221187 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: warnings.warn(msg) Jul 12 13:39:53.222743 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-695ff0f6-f8b2-4cd7-9b75-3d0fcce17d4f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:39:53.223235 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-695ff0f6-f8b2-4cd7-9b75-3d0fcce17d4f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:39:53.224043 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-695ff0f6-f8b2-4cd7-9b75-3d0fcce17d4f admin admin] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:39:53.224467 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-695ff0f6-f8b2-4cd7-9b75-3d0fcce17d4f admin admin] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:39:53.243571 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-695ff0f6-f8b2-4cd7-9b75-3d0fcce17d4f admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078134 Jul 12 13:39:53.244121 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 36/72] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jul 12 13:39:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:40:04.511122 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-9658aa2e-cd03-47e0-acda-cfa4239dc0aa admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:40:04.512128 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-9658aa2e-cd03-47e0-acda-cfa4239dc0aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 12 13:40:04.512531 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:40:04.655717 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writing DB stats nova_cell0:SELECT=4 {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:40:04.656427 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writing DB stats nova_cell1:SELECT=4 {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:40:04.657033 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG dbcounter [-] [109945] Writing DB stats nova_api:SELECT=8 {{(pid=109945) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:40:04.705584 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-af4b8c67-75ad-4c7b-8264-8a7be160bbed admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:40:04.706779 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:40:04.706779 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: warnings.warn(msg) Jul 12 13:40:04.707970 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-af4b8c67-75ad-4c7b-8264-8a7be160bbed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:40:04.708403 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-af4b8c67-75ad-4c7b-8264-8a7be160bbed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:40:04.709176 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-af4b8c67-75ad-4c7b-8264-8a7be160bbed admin admin] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:40:04.709632 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-af4b8c67-75ad-4c7b-8264-8a7be160bbed admin admin] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:40:04.735164 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-af4b8c67-75ad-4c7b-8264-8a7be160bbed admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083806 Jul 12 13:40:04.735639 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 37/74] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jul 12 13:40:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:40:05.557432 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: DEBUG nova.api.openstack.wsgi [None req-9658aa2e-cd03-47e0-acda-cfa4239dc0aa admin admin] Calling method '>' {{(pid=109944) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:40:05.558516 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: INFO nova.api.openstack.requestlog [None req-9658aa2e-cd03-47e0-acda-cfa4239dc0aa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Jul 12 13:40:05.558917 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: [pid: 109944|app: 0|req: 38/75] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Jul 12 13:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:40:05.746480 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG nova.api.openstack.wsgi [None req-510d8ca3-4700-4a06-a3bd-4c91f8429a47 admin admin] Calling method '>' {{(pid=109945) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:40:05.747671 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:40:05.747671 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: warnings.warn(msg) Jul 12 13:40:05.749540 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-510d8ca3-4700-4a06-a3bd-4c91f8429a47 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:40:05.750010 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-510d8ca3-4700-4a06-a3bd-4c91f8429a47 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:40:05.750797 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-510d8ca3-4700-4a06-a3bd-4c91f8429a47 admin admin] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:40:05.751515 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: DEBUG oslo_concurrency.lockutils [None req-510d8ca3-4700-4a06-a3bd-4c91f8429a47 admin admin] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109945) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:40:05.772754 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: INFO nova.api.openstack.requestlog [None req-510d8ca3-4700-4a06-a3bd-4c91f8429a47 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077476 Jul 12 13:40:05.773239 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: [pid: 109945|app: 0|req: 38/76] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Jul 12 13:40:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:41:01.977009 dv-cinder-797970-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 13:41:01.978060 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: Tue Jul 12 13:41:01 2022 - graceful shutdown triggered... Jul 12 13:41:01.978497 dv-cinder-797970-4-iscsi devstack@n-api.service[109945]: Gracefully killing worker 2 (pid: 109945)... Jul 12 13:41:01.978847 dv-cinder-797970-4-iscsi devstack@n-api.service[109944]: Gracefully killing worker 1 (pid: 109944)... Jul 12 13:41:02.978946 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: worker 1 buried after 1 seconds Jul 12 13:41:02.979480 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: worker 2 buried after 1 seconds Jul 12 13:41:02.979480 dv-cinder-797970-4-iscsi devstack@n-api.service[109943]: goodbye to uWSGI. Jul 12 13:41:02.980561 dv-cinder-797970-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 13:41:02.981111 dv-cinder-797970-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 13:41:02.984000 dv-cinder-797970-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 13:41:02.994434 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 13:41:02 2022] *** Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: nodename: dv-cinder-797970-4-iscsi Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: machine: x86_64 Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: clock source: unix Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: pcre jit disabled Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: detected number of CPU cores: 4 Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: current working directory: / Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: detected binary path: /usr/bin/uwsgi-core Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: your processes number limit is 47680 Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: your memory page size is 4096 bytes Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: detected max file descriptor number: 2048 Jul 12 13:41:02.996427 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: lock engine: pthread robust mutexes Jul 12 13:41:02.997322 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: thunder lock: enabled Jul 12 13:41:02.997322 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 13:41:02.997322 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 13:41:03.041872 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: Python main interpreter initialized at 0x55c0721ea9c0 Jul 12 13:41:03.041872 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: python threads support enabled Jul 12 13:41:03.041872 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: your server socket listen backlog is limited to 100 connections Jul 12 13:41:03.041872 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: your mercy for graceful operations on workers is 90 seconds Jul 12 13:41:03.042328 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 13:41:03.042328 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: *** Operational MODE: preforking *** Jul 12 13:41:03.042559 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: *** uWSGI is running in multiple interpreter mode *** Jul 12 13:41:03.042559 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: spawned uWSGI master process (pid: 124451) Jul 12 13:41:03.042762 dv-cinder-797970-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 13:41:03.045944 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: spawned uWSGI worker 1 (pid: 124465, cores: 1) Jul 12 13:41:03.045944 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: spawned uWSGI worker 2 (pid: 124466, cores: 1) Jul 12 13:41:03.045944 dv-cinder-797970-4-iscsi devstack@n-api.service[124451]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 13:41:03.720320 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:41:03.721805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 13:41:04.915751 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:41:04.915751 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: from cryptography.utils import int_from_bytes Jul 12 13:41:04.916372 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:41:04.916372 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: from cryptography.utils import int_from_bytes Jul 12 13:41:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:41:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: from cryptography.utils import int_from_bytes Jul 12 13:41:04.920025 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:41:04.920025 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: from cryptography.utils import int_from_bytes Jul 12 13:41:07.249834 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:41:07.250514 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:41:07.250659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:41:07.250836 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:41:07.251497 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:41:07.251587 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:41:07.251676 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:41:07.251859 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:41:07.251965 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.252225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:41:07.252331 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.252488 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:41:07.252594 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.252864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.252954 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.253200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.253287 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.253518 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.253623 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.253841 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.253939 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.254192 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.254297 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.254510 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.254608 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.254784 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.254874 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.255106 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.255205 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.255439 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-4-iscsi {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.255536 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.255726 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.255848 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.256049 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.256165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.256368 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.256479 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-4-iscsi {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.256698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.256805 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.257008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.257115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.257326 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.257430 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.257636 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.257742 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.257949 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.258196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.258306 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.259330 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.259442 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.259442 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.259595 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.259700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.259775 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.259877 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.259950 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.260029 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.260108 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.260215 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.260492 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.260615 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.260707 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.260855 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.261008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.261169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.261307 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.261500 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.261628 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.261911 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-4-iscsi {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.262057 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.262255 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.262366 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.262613 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.262776 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-4-iscsi {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.262915 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.263066 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.263256 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.263402 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.263572 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.263666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.263915 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.264008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.264245 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.264380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.264577 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.264675 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.264892 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.264990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.265219 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.265322 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.265536 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.265636 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.265907 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.266050 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.266286 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.266407 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.266625 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.266725 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.266942 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.267053 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.267275 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.267407 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.267603 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.267771 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.267937 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.268039 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.268248 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.268357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.268566 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.268673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.268880 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.268981 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.269155 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.269252 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.269456 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.269579 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.269786 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.269898 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.270155 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.270301 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.270479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.270578 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.270751 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.270918 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.271104 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.271283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.271435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.271580 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.271733 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.271879 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.272023 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.272174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.272337 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.272491 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.272688 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.272872 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.273020 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.273164 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.273309 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.273461 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.273651 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.273806 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.273952 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.274138 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.274306 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.274460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.274620 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.274778 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.274930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.275085 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.275236 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.275381 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.275536 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.275741 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.275922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.276066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.276201 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.276390 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.276525 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.276665 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.276764 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.276962 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.277062 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.277280 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.277416 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.277609 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.277709 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.278072 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.278217 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.278469 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.278572 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.278763 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.278854 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.279081 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.279217 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.279451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.279625 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.279819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.279965 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.280169 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.280273 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.280489 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.280579 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.280752 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.280852 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.281063 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.281171 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.281379 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.281477 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.281711 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.281808 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.282051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.282411 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.282547 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.282734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.282850 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.283047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.283146 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.283364 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.283499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.283711 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.283861 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.284013 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.284283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.284382 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.284627 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.284786 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.284939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.285031 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.285308 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.285406 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.285622 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.285713 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.285988 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.286154 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.286329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.286658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.286828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.286981 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.287132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.287283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.287447 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.287597 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.287699 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.287786 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.287908 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.288098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.288238 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.288465 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.288607 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.288799 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.288889 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.289117 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.289218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.289987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.290104 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.290297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.290395 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.290612 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.290712 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.290924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.291016 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.291238 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.291327 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.291553 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.291645 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.291863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.291959 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.292178 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.292276 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.292483 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.292781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.292879 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.293108 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.293205 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.293420 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.293522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.293734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.293838 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.294083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.294183 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.294381 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.294481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.294689 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.294834 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.295000 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.295089 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.295306 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.295396 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.295614 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.295709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.295919 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.296007 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.296245 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.296347 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.296560 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.296660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.296876 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.297016 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.297186 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.297276 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.297496 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.297593 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.297824 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:41:07.297925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.298196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.298289 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.298538 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.298637 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.298863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.298961 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.299205 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.299294 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.299545 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.299635 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.299874 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.299974 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.300198 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.300296 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.300517 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.300612 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.300840 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.300943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.301158 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.301247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.301479 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.301568 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.301795 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.301930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.302141 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.302243 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.302470 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.302569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.302798 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.302906 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.303136 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.303279 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.303462 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.303552 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.303786 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.303889 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.304102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.304199 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.304417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.304517 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.304743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.304847 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.305096 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.305695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.305944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.306059 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.306287 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.306400 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.306638 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.306730 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.306992 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.307083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.307314 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.307446 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.307645 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.307744 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.307964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.308055 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.308282 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.308372 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.308597 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.308687 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.308909 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.308998 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.309266 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.309363 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.309619 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.309717 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.309950 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.310294 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.310651 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.310811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.310964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.311118 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.311274 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.311417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.311580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.311732 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.311913 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.312062 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.312214 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.312365 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.312538 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.312701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.312844 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.312985 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.313166 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.313327 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.313479 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.313632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.313787 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.313938 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.314121 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.314278 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.314422 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.314595 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.314752 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.314916 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.315008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.315235 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.315334 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.315549 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.315639 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.315863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.315967 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.316177 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.316268 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.316496 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.316597 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.316816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.316923 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.317144 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.317245 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.317477 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.317569 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.317788 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.317891 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.318953 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.319091 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.319203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.319293 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.319377 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.319475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.319561 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.319650 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.319733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.319821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.319981 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.320142 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.320231 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.320320 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.320418 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.320503 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.320594 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.320707 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.320914 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.321015 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.321234 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.321332 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.321547 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.321646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.321876 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.322025 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.322296 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.322424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.322623 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.322811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.322944 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.323136 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.323276 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.323456 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.323600 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.323776 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.323921 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.324094 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.324265 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.324413 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.324605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.324745 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.324922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.325065 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.325257 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.325385 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.325590 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.325728 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.325916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.326092 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.326252 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.326408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.326569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.326747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.326881 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.327079 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.327220 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.327403 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.327496 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.327714 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.327804 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.328029 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.328128 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.328340 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.328433 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.328650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.328740 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.328964 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.329067 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.329279 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.329369 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.329591 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.329689 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.329901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.330029 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.330238 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.330335 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.330547 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.330643 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.330857 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.330956 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.331182 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.331278 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.331497 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.331587 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.331808 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.331907 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.332118 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.332209 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.332429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.332527 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.332781 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.332872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.333094 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.333192 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.333423 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.333519 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.333746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.333888 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.334103 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.334192 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.334402 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.334503 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.334723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.334821 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.335053 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.335143 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.335375 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.335477 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.335705 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.335795 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.336025 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.336123 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.336369 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.336474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.336693 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.336791 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.337014 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.337114 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.337332 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.337470 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.337649 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.337745 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.338002 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.338096 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.338325 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.338435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.338652 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.338743 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.338965 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.339056 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.339287 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.339384 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.339609 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.339707 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.339928 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.340025 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.340249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.340348 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.340569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.340668 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.340883 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.340978 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.341203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.341295 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.341521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.341625 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.341836 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.341935 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.342181 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.342282 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.342498 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.342624 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.342821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.342951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.343137 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.343235 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.343448 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.343545 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.343763 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.343861 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.344135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.344226 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.344472 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.344568 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.344845 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.344978 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.345158 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.345283 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.345479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.345606 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.345814 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.345947 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.346186 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.346315 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.346509 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.346635 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.346827 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.346953 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.347148 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.347267 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.347469 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.347585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.347792 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.347909 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.348110 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.348234 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.348421 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.348537 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.348733 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.348849 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.349129 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.349254 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.349363 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.350142 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.350142 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.350480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.350596 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.350706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.350821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.350938 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.351158 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.351290 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.351512 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.351630 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.351827 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.352471 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.352697 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.352815 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.353019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.353145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.353350 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.353487 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.353680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.353805 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.354202 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.354362 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.354507 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.354665 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.354816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.354966 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.355108 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.355252 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.355394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.355550 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.355700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.355843 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.355995 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.356144 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.356301 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.356444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.356586 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.356728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.356869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.357010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.357166 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.357313 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.357462 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.357604 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.357753 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.357913 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.358092 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.358273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.358428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.358647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.358863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.359021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.359290 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.359608 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.359927 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.360075 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.360247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.360406 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.360561 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.360869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.361037 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.361203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.361359 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.361518 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.361661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.361826 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.362046 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.362207 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.362351 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.362502 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.362662 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.362817 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.362972 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.363137 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.363297 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.363447 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.363694 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.363853 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.364037 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.364203 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.364443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.364592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.364735 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.364943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.365102 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.365286 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.365446 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.365611 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.365768 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.365940 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.366122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.366273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.366431 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.366603 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.366770 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.366923 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.367074 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.367240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.367389 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.367560 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.368224 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.368408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.368568 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.368718 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.368863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.369015 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.369166 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.369316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.369460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.369620 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.369921 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.370259 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.370409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.370573 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.370734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.370885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.371038 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.371181 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.371330 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.371473 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.371614 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.371795 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.371955 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.372099 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.372248 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.372425 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.372583 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.372734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.372885 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.373038 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.373182 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.373330 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.373500 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.373652 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.373820 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.373989 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.374159 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.374310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.374476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.374761 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.374920 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.375070 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.375220 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.375369 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.375525 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.375684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.375841 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.376010 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.376432 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.376587 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.376745 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.376903 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.377060 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.377219 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.377368 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.377525 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.377684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.377842 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.378027 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.378205 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.378357 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.378506 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.378663 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.378820 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.378970 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.379129 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.379286 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.379443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.379801 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.379974 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.379974 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.380271 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.380434 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.380434 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.380739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.380889 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.381038 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.381187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.381343 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.381507 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.381659 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.381808 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.381974 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.382132 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.382293 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.382540 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.382699 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.382857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.383014 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.383199 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.383362 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.383530 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.383689 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.383839 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.383996 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.384145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.384308 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.384459 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.384627 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.384885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.385051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.385210 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.385374 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.385523 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.385683 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.385840 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.386019 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.386183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.386354 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.386514 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.386672 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.386834 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.386992 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.387151 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.387315 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.387465 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.387622 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.387780 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.387945 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.388103 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.388260 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.388417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.388573 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.388733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.388891 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.390283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.390283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.390613 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.390766 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.390925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.391083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.391083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.391083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.391083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.391843 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.392003 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.392003 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.392313 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.392463 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.392611 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.392760 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.392909 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.393071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.393229 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.393398 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.393398 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.393683 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.393840 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.394027 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.394196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.394354 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.394503 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.394661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.394810 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.394969 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.395121 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.395271 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.395271 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.395581 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.395819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.395985 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.396137 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.396302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.396452 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.396608 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.396767 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.396926 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.397076 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.397226 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.397381 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.397538 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.397700 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.397859 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.398055 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.398213 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.398374 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.398532 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.398695 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.398874 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.399025 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.399174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.399324 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.399472 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.399472 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.399786 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.399943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.400092 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.400092 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.400388 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.400547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.400740 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.400891 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.401047 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.401204 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.401369 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.401519 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.401667 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.401667 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.401667 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.401667 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.402274 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.402427 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.402575 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.402723 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.402880 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.403030 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.403187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.403351 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.403516 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.403666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.403814 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.403970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.404129 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.404294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.404443 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.404599 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.404749 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.404907 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.405065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.405214 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.405214 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.405497 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.405647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.405826 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.406105 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.406273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.406445 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.406605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.406755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.406913 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.407071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.407071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.407373 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.407522 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.407714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.407714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.408027 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.408027 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.408329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.408478 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.408640 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.408792 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.408940 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.409089 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.409237 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.409394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.409552 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.409702 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.409860 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.410039 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.410202 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.410370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.410530 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.410680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.410838 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.410988 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.410988 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.411270 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.411430 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.411430 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.411732 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.411891 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.412048 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.412205 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.412375 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.412525 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.412672 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.412837 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.412987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.413151 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.413315 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.413476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.413627 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.413777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.413777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.414100 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.414253 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.414926 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.414926 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.415230 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.415380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.415539 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.415689 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.415837 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.415986 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.416154 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.416402 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.416556 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.416715 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.416883 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.417031 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.417180 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.417424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.417590 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.417789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.418135 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.418308 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.418469 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.418672 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.418838 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.419086 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.419243 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.419414 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.419692 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.419859 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.420010 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.420165 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.420328 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.420635 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.420959 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.421290 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.421453 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.421712 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.422037 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.422209 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.422489 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.422646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.422797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.423011 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.423180 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.423332 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.423600 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.423765 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.423916 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.424079 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.424238 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.424517 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.424684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.424835 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.425070 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.425247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.425447 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.425611 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.425761 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.426089 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.426261 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.426438 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.426688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.426850 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.427000 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.427231 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.427397 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.427623 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.427894 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.428053 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.428266 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.428422 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.428579 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.428879 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.429044 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.429193 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.429400 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.429559 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.429805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.429991 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.430827 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.431020 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.431373 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.431687 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.431843 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.432004 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.432339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.432496 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.432680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.432866 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.433033 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.433325 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.433482 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.433659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.433869 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.434163 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.434334 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.434485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.434642 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.434907 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.435066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.435216 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.435414 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.435594 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.435820 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.435985 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.436144 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.436405 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.436579 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.436846 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.437009 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.437160 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.437309 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.437466 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.437618 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.437923 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.438141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.438300 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.438816 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.438983 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.439208 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.439364 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.439521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.439814 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.439985 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.440164 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.440330 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.440480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.440798 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.440955 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.441114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.441437 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.441772 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.442113 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.442275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.442438 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.442703 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.442861 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.443064 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.443220 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.443389 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.443692 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.443849 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.443999 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.444192 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.444351 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.444623 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.444791 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.444943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.445190 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.445357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.445553 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.445906 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.446121 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.446482 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.446639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.446907 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.447081 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.447247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.447471 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.447635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.447786 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.447935 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.448106 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.448426 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.448584 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.448744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.448936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.449102 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.449347 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.449514 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.449666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.449945 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.450142 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.450329 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.450494 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.450720 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.450993 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.451168 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.451319 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.451625 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.451948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.452111 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.452263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.452445 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.452609 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.452787 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.452961 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.453122 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.453273 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.453442 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.453593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.453792 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.453950 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.454178 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.454337 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.454494 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.454645 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.454807 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.454964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.455114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.455263 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.455412 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.455578 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.455743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.455995 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.456160 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.456342 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.456498 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.456663 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.457044 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.457218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.457370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.457520 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.457677 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.458004 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.458178 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.458331 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.458488 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.458638 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.458950 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.459122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.459426 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.459584 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.459768 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.459932 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.460084 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.460374 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.460546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.460734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.460951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.461123 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.461896 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.462258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.462573 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.462795 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.462954 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.463196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.463362 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.463513 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.463717 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.463886 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.464045 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.464196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.464360 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.464524 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.464682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.464839 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.464996 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.465154 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.465367 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.465576 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.465734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.465937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.466149 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.466309 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.466461 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.466610 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.466775 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.466925 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.467081 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.467366 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.467523 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.467673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.467853 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.468010 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.468174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.468337 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.468489 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.468789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.468944 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.469094 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.469352 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.469521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.469709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.469866 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.470071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.470363 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.470530 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.470701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.470851 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.471000 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.471294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.471458 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.471623 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.471931 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.472247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.472562 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.472718 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.472876 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.473180 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.473336 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.473504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.473725 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.473883 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.474112 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.474315 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.474473 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.474733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.474896 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.475048 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.475214 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.475366 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.475523 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.475683 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.475844 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.476002 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.476160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.476311 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.476605 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.476760 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.477056 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.477802 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.478012 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.478171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.478333 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.478484 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.478644 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.478794 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.478958 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.479109 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.479266 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.479424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.479584 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.479748 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.479898 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.480056 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.480286 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.480444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.480774 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.480952 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.481214 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.481371 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.481530 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.481869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.482060 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.482230 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.482550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.482864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.483155 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.483321 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.483486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.483686 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.483852 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.484109 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.484273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.484426 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.484713 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.484873 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.485033 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.485209 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.485375 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.485639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.485809 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.486029 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.486283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.486440 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.486592 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.486820 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.486985 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.487137 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.487294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.487446 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.487604 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.487768 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.488033 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.488207 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.488368 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.488519 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.488769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.489098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.489424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.489557 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.489749 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.489976 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.490131 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.490417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.490551 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.490737 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.490972 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.491112 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.491365 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.491504 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.491704 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.491936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.492169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.492308 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.492450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.492769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.492912 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.493090 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.493391 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.493538 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.493733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.493925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.494077 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.494391 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.494531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.494724 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.495043 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.495200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.495372 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.495530 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.495707 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.495873 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.496031 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.496267 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.496432 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.496608 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.496782 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.496963 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.497122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.497273 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.497428 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.497587 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.497751 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.497920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.498119 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.498369 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.498543 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.498695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.498856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.499008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.499165 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.499316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.499466 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.499615 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.499778 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.499930 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.500090 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.500240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.500396 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.500557 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.500708 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.500857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.501015 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.501425 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.501586 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.501755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.501914 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.502089 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.502250 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.502410 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.502410 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.502706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.502863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.503013 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.503163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.503312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.503495 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.503663 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.503840 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.503998 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.504156 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.504325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.504485 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.504636 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.504792 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.504950 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.505099 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.505257 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.505417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.505576 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.505739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.505890 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.506080 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.506249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.506429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.506582 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.506732 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.506888 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.507047 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.507197 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.507357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.507515 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.507673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.507824 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.507981 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.508140 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.508320 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.508587 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.508754 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.508921 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.509071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.509235 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.509388 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.509537 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.509694 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.509852 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.510051 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.510222 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.510381 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.510543 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.510701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.510851 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.511009 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.511160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.511160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.511454 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.511604 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.511763 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.511923 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.512081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.512239 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.512398 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.512574 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.512725 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.512884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.513042 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.513193 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.513349 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.513507 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.513658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.513816 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.513993 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.514151 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.514302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.514472 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.514634 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.514793 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.514950 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.515101 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.515257 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.515416 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.515576 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.515729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.515878 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.516027 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.516192 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.516347 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.516520 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.516672 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.516829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.516989 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.517140 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.517298 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.517457 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.517457 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.517760 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.517912 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.518124 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.518355 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.518507 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.518507 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.518910 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.519062 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.519219 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.519383 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.519535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.519684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.519847 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.520005 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.520164 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.520329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.520489 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:41:07.520652 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.520652 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.520957 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.521219 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.521539 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.521861 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.522222 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.522545 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.522868 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.523189 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.523508 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.524353 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.524677 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.525007 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.525366 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.525700 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.526052 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.526377 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.526704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.527027 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.527348 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.527669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.527991 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.528336 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.528662 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.528991 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.529292 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.529738 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.530106 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.530426 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.530758 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.531079 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.531416 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.531751 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.532072 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.532403 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.532725 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.533066 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.533420 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.533762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.534413 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.534413 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.534730 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.535045 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.535367 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.535699 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.536021 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.536334 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.536646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.536965 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.537281 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.537670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.539166 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.540033 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.540405 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.540686 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.541004 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.541321 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.541638 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.542116 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.542304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.542595 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.542911 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.543225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.543538 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.543854 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.544210 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.544713 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.544878 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.545167 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.545502 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.545825 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.546687 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.546687 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.547009 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.547169 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.547449 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.547769 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.548265 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.548436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.548739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.549107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.549435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.549752 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.550110 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.550456 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.550788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.551107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.551443 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.551788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.552095 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.552424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.552747 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.553091 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.553413 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.553731 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.554083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.554407 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.554924 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.555147 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.555400 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.555741 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.556076 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.556395 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.556731 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.557079 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.557431 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.557755 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.558138 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.558483 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.558825 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.559126 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.559544 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:41:07.559722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:41:07.674590 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO dbcounter [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Registered counter for database nova_api Jul 12 13:41:07.694340 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_db.sqlalchemy.engines [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:41:07.701529 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writer thread running {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:41:07.711925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO dbcounter [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Registered counter for database nova_api Jul 12 13:41:07.731888 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_db.sqlalchemy.engines [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:41:07.738743 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writer thread running {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:41:07.758656 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.context [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c4e355e-53a6-4660-8086-68fb4f4fbe3f(cell1) {{(pid=124466) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:41:07.762612 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:41:07.764198 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:41:07.765010 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:41:07.766994 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:41:07.768988 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO dbcounter [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Registered counter for database nova_cell0 Jul 12 13:41:07.773053 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO dbcounter [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Registered counter for database nova_cell1 Jul 12 13:41:07.782750 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_db.sqlalchemy.engines [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:41:07.784781 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_db.sqlalchemy.engines [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:41:07.795694 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writer thread running {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:41:07.801159 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.context [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8c4e355e-53a6-4660-8086-68fb4f4fbe3f(cell1) {{(pid=124465) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 13:41:07.803028 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writer thread running {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:41:07.805206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:41:07.806848 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:41:07.807660 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:41:07.809620 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:41:07.811646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO dbcounter [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Registered counter for database nova_cell0 Jul 12 13:41:07.815743 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO dbcounter [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Registered counter for database nova_cell1 Jul 12 13:41:07.823551 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_db.sqlalchemy.engines [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:41:07.825302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_db.sqlalchemy.engines [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:41:07.831376 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writer thread running {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:41:07.833222 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writer thread running {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:41:07.951983 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO dbcounter [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Registered counter for database nova_cell0 Jul 12 13:41:07.958456 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_db.sqlalchemy.engines [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:41:07.963699 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writer thread running {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:41:07.988415 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO dbcounter [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Registered counter for database nova_cell0 Jul 12 13:41:07.995898 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_db.sqlalchemy.engines [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:41:08.000591 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writer thread running {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:41:08.283889 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: WARNING keystonemiddleware.auth_token [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:41:08.291170 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: WARNING keystonemiddleware.auth_token [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:41:08.326392 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: WARNING keystonemiddleware.auth_token [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:41:08.333756 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: WARNING keystonemiddleware.auth_token [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:41:08.631263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: WARNING keystonemiddleware.auth_token [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:41:08.637274 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: WARNING keystonemiddleware.auth_token [None req-037854f6-8f62-4847-bd1a-5532ab8576b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:41:08.642568 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c0721ea9c0 pid: 124466 (default app) Jul 12 13:41:08.676551 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: WARNING keystonemiddleware.auth_token [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 13:41:08.683116 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: WARNING keystonemiddleware.auth_token [None req-cf0704af-fc16-49a7-aa9b-1671348864ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 13:41:08.688408 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c0721ea9c0 pid: 124465 (default app) Jul 12 13:41:49.976722 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:49.979311 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:49.982326 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:49.983385 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:51.059596 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2cf6edf9-d73b-4800-9221-a663f0a04215 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] Action: 'create', calling method: .version_select at 0x7f3a17c545e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-940353233", "metadata": {"Type": "work"}}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:41:52.310913 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2cf6edf9-d73b-4800-9221-a663f0a04215 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.351089 Jul 12 13:41:52.311602 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jul 12 13:41:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2354 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 13:41:52.652968 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-df772e27-9bc6-4fb4-a9e5-a29e44bea232 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] Calling method '.version_select at 0x7f3a17d801f0>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:41:52.693293 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=3 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:52.694810 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=3 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:52.696381 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=3 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:52.697284 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=3 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:53.078187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-df772e27-9bc6-4fb4-a9e5-a29e44bea232 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e" status: 200 len: 353 microversion: 2.1 time: 0.756894 Jul 12 13:41:53.078902 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 1/2] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:41:52 2022] GET /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e => generated 353 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:41:53.091519 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a829c019-5c56-402c-b8a1-441a31178e46 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] Calling method '.version_select at 0x7f3a17b184c0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:41:53.184523 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a829c019-5c56-402c-b8a1-441a31178e46 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e" status: 200 len: 353 microversion: 2.1 time: 0.097417 Jul 12 13:41:53.185622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:41:53 2022] GET /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:41:53.206221 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-2e3b11c5-b859-4c9c-90e8-da09d11be810 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] Calling method '.version_select at 0x7f3a17b114c0>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:41:53.422227 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-2e3b11c5-b859-4c9c-90e8-da09d11be810 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e" status: 202 len: 0 microversion: 2.1 time: 0.221780 Jul 12 13:41:53.423480 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jul 12 13:41:53 2022] DELETE /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:41:53.436933 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0c97606b-9c97-4a22-b5f7-071a54ef5b45 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] Calling method '.version_select at 0x7f3a17b18820>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:41:53.581449 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0c97606b-9c97-4a22-b5f7-071a54ef5b45 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e" status: 200 len: 352 microversion: 2.1 time: 0.154326 Jul 12 13:41:53.586500 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:41:53 2022] GET /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:41:54.594561 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0698494f-5ebc-4ab2-8386-575c0fc73068 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] Calling method '.version_select at 0x7f3a17b11550>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:41:54.872135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-0698494f-5ebc-4ab2-8386-575c0fc73068 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] HTTP exception thrown: Volume 5c492764-bea7-475d-9dc0-d9b7aa620b2e could not be found. Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0698494f-5ebc-4ab2-8386-575c0fc73068 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] Request method failure captured: Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e HTTP/1.1 Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXodz_Ea0NeMKLvatCV6BCddbCYFHxPAKNdjYkoUE6jCH1rXIkZ6kxG3UhHkWjv46YAjYaYpANOfP8XvCYjqEwNQTVlEatN7eqatVO0qPPaIimItzd0OND2eK2lsD1zc28KBwteuw6XXYKm7GHemlnVJUOIRKS-ZV_vH5gC5W-DVG98 Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 39665fbd2b3e4900814a6b38511daa92 Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-VolumesGetTestJSON-1803203638 Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:41:54.876884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39665fbd2b3e4900814a6b38511daa92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/39665fbd2b3e4900814a6b38511daa92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/39665fbd2b3e4900814a6b38511daa92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_39665fbd2b3e4900814a6b38511daa92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-VolumesGetTestJSON-1803203638 Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 39665fbd2b3e4900814a6b38511daa92 Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-VolumesGetTestJSON-1803203638 Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-VolumesGetTestJSON-1803203638-project Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 7b9f6f3742e84dfb92bed76ea8ea38fb Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-VolumesGetTestJSON-1803203638-project Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Volume 5c492764-bea7-475d-9dc0-d9b7aa620b2e could not be found. Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '5c492764-bea7-475d-9dc0-d9b7aa620b2e'} Jul 12 13:41:54.878361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c492764-bea7-475d-9dc0-d9b7aa620b2e could not be found. (HTTP 404) (Request-ID: req-15eeb545-e1d8-4fa7-bcda-cadb722855d6) Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:41:54.879206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:41:54.880490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c492764-bea7-475d-9dc0-d9b7aa620b2e could not be found. Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 13:41:54.881727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c492764-bea7-475d-9dc0-d9b7aa620b2e could not be found. Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c492764-bea7-475d-9dc0-d9b7aa620b2e could not be found. Jul 12 13:41:54.886112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:41:54.888435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0698494f-5ebc-4ab2-8386-575c0fc73068 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] Returning 404 to user: Volume 5c492764-bea7-475d-9dc0-d9b7aa620b2e could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:41:54.889546 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0698494f-5ebc-4ab2-8386-575c0fc73068 tempest-VolumesGetTestJSON-1803203638 tempest-VolumesGetTestJSON-1803203638-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e" status: 404 len: 109 microversion: 2.1 time: 0.299470 Jul 12 13:41:54.893050 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:41:54 2022] GET /compute/v2.1/os-volumes/5c492764-bea7-475d-9dc0-d9b7aa620b2e => generated 109 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:42:03.576483 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-16812817", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "networks": [{"uuid": "02dc7788-9dcd-4a6a-b074-afcce8e5bbbe"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:03.798642 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] validate_networks() for [('02dc7788-9dcd-4a6a-b074-afcce8e5bbbe', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:42:03.950398 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1844278056", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:04.140472 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.network.neutron [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] validate_networks() for [('65fde899-6b5b-4bfd-b67c-81e8b9e24842', None, None, None, None, None)] {{(pid=124465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:42:05.942868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:42:05.943300 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:42:05.943769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:42:05.944762 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:42:05.945184 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:42:05.980361 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:05.980831 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:05.981649 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:05.982157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:06.072291 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Getting quotas for project 3f5464e5ca174b398ebb28ad3e8a84f1. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:42:06.089551 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Getting quotas for user c25bdc429c3c4f8ba33ee4042f128c8e and project 3f5464e5ca174b398ebb28ad3e8a84f1. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:42:06.118533 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:42:06.122157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:42:06.341470 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3ee77158-bd4f-4f99-829d-3d558510b676 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.004640 Jul 12 13:42:06.345086 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 4/7] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:42:06.356381 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-40f8d617-9240-44a6-bc6e-313f536f5583 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:06.367907 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-40f8d617-9240-44a6-bc6e-313f536f5583 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:06.659844 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-40f8d617-9240-44a6-bc6e-313f536f5583 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:06.697364 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-40f8d617-9240-44a6-bc6e-313f536f5583 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1213 microversion: 2.1 time: 0.345026 Jul 12 13:42:06.711900 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 5/8] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:06 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1213 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:07.719896 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-90d36e07-ae7a-4f2e-a5ce-c841b138deef tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:07.722783 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-90d36e07-ae7a-4f2e-a5ce-c841b138deef tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:07.839341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-90d36e07-ae7a-4f2e-a5ce-c841b138deef tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:07.848032 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-90d36e07-ae7a-4f2e-a5ce-c841b138deef tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1213 microversion: 2.1 time: 0.134149 Jul 12 13:42:07.849255 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 6/9] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:07 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:08.869849 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-51011239-7c89-4115-826a-815b45a64875 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:08.871961 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-51011239-7c89-4115-826a-815b45a64875 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:08.896990 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-51011239-7c89-4115-826a-815b45a64875 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:08.899903 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-51011239-7c89-4115-826a-815b45a64875 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:08.901751 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-51011239-7c89-4115-826a-815b45a64875 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:08.903923 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-51011239-7c89-4115-826a-815b45a64875 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:09.206483 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Flavor limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:42:09.206956 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Image limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:42:09.207586 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Flavor pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:42:09.208012 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Image pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:42:09.208432 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:42:09.239699 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:09.242108 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:09.243771 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:09.244951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:09.287304 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-51011239-7c89-4115-826a-815b45a64875 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:09.316940 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-51011239-7c89-4115-826a-815b45a64875 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1209 microversion: 2.1 time: 0.454647 Jul 12 13:42:09.327622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 7/10] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:08 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1209 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:09.398741 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Getting quotas for project 026f214eb4ee4a9c807b928710c93db5. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:42:09.412429 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Getting quotas for user 4a6b3bd40ad744908a05df7410cace52 and project 026f214eb4ee4a9c807b928710c93db5. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:42:09.449099 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Going to run 1 instances... {{(pid=124465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:42:09.454948 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:42:09.557161 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3ba65d71-5d85-4b72-998c-a7240eee7c57 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.738249 Jul 12 13:42:09.558326 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 4/11] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:42:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 5740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:42:09.580489 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ac17b6ce-4664-434f-898c-3acf1d938d98 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:09.582373 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ac17b6ce-4664-434f-898c-3acf1d938d98 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:09.791753 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ac17b6ce-4664-434f-898c-3acf1d938d98 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:09.804462 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ac17b6ce-4664-434f-898c-3acf1d938d98 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1222 microversion: 2.1 time: 0.238077 Jul 12 13:42:09.811300 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 8/12] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:09 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1222 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:10.342516 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9b8b862b-f2cb-40ed-b286-91400c7414cb tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:10.344201 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9b8b862b-f2cb-40ed-b286-91400c7414cb tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:10.386102 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9b8b862b-f2cb-40ed-b286-91400c7414cb tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:10.386571 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9b8b862b-f2cb-40ed-b286-91400c7414cb tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:10.391696 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9b8b862b-f2cb-40ed-b286-91400c7414cb tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:10.392154 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9b8b862b-f2cb-40ed-b286-91400c7414cb tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:10.806384 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9b8b862b-f2cb-40ed-b286-91400c7414cb tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:10.822810 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9b8b862b-f2cb-40ed-b286-91400c7414cb tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1271 microversion: 2.1 time: 0.488771 Jul 12 13:42:10.826803 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 9/13] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:10 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1271 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:10.848725 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-710743218", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:11.060486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] validate_networks() for [('65fde899-6b5b-4bfd-b67c-81e8b9e24842', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:42:11.343625 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ca60f89a-2048-4cbf-be46-ba35fc6965ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'create', calling method: .version_select at 0x7f3a171920d0>, body: {"keypair": {"name": "tempest-keypair-235067066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyNgYwvX1fgbzqQ/LbQT+T6Axd0B18RLeglqsD+MWvkIypBa2C/IHJ4DxY0qZt1GxCqOSmXlJOdu8gIdslTNe/oDniaMEJsHaZ4lG/Dx4Qii8+pFuqj/ILmsj+5AmmoTA=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:11.423694 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-ca60f89a-2048-4cbf-be46-ba35fc6965ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Getting quotas for project 5f431e3ab50a4133916f6175a2ef1b4f. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:42:11.441350 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-ca60f89a-2048-4cbf-be46-ba35fc6965ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Getting quotas for user 2ad8ebe54a1d42eda9b23108f92a1d23 and project 5f431e3ab50a4133916f6175a2ef1b4f. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:42:11.564692 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ca60f89a-2048-4cbf-be46-ba35fc6965ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.325008 Jul 12 13:42:11.565854 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 5/14] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jul 12 13:42:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:11.850170 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-9fb43789-87e7-4607-85ed-1760bcfe39cf tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:11.851407 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-9fb43789-87e7-4607-85ed-1760bcfe39cf tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:11.899230 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9fb43789-87e7-4607-85ed-1760bcfe39cf tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:11.902599 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9fb43789-87e7-4607-85ed-1760bcfe39cf tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:11.907385 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9fb43789-87e7-4607-85ed-1760bcfe39cf tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:11.907718 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9fb43789-87e7-4607-85ed-1760bcfe39cf tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:13.639081 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-9fb43789-87e7-4607-85ed-1760bcfe39cf tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:13.685794 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-9fb43789-87e7-4607-85ed-1760bcfe39cf tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1271 microversion: 2.1 time: 1.843392 Jul 12 13:42:13.697664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 6/15] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:11 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1271 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:14.719358 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-968c7153-ec44-4af4-b24d-2c5c423b560d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:14.720431 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-968c7153-ec44-4af4-b24d-2c5c423b560d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:14.730594 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-968c7153-ec44-4af4-b24d-2c5c423b560d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:14.731273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-968c7153-ec44-4af4-b24d-2c5c423b560d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:14.732536 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-968c7153-ec44-4af4-b24d-2c5c423b560d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:14.733659 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-968c7153-ec44-4af4-b24d-2c5c423b560d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:15.125335 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-968c7153-ec44-4af4-b24d-2c5c423b560d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:15.140543 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-968c7153-ec44-4af4-b24d-2c5c423b560d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1271 microversion: 2.1 time: 0.426106 Jul 12 13:42:15.142207 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 7/16] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:14 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1271 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:15.325880 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:42:15.326419 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:42:15.327064 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:42:15.327551 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:42:15.328040 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:42:15.366356 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:15.372070 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:15.381490 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:15.381968 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:15.471647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Getting quotas for project 026f214eb4ee4a9c807b928710c93db5. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:42:15.507564 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Getting quotas for user 4a6b3bd40ad744908a05df7410cace52 and project 026f214eb4ee4a9c807b928710c93db5. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:42:15.604963 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:42:15.611825 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:42:15.768939 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-488b8cc3-b7c6-476d-b751-d0524beb4a9f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.939162 Jul 12 13:42:15.781291 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-eb959fd7-dc09-41bd-89d3-b3b23081674e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:15.781856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-eb959fd7-dc09-41bd-89d3-b3b23081674e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:15.785139 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 10/17] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:42:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 4958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:42:16.159411 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-352bbee9-f284-40b0-bfe4-c652f3585d32 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:16.160370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-352bbee9-f284-40b0-bfe4-c652f3585d32 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:16.188870 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-352bbee9-f284-40b0-bfe4-c652f3585d32 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:16.191632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-352bbee9-f284-40b0-bfe4-c652f3585d32 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:16.195169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-352bbee9-f284-40b0-bfe4-c652f3585d32 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:16.197086 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-352bbee9-f284-40b0-bfe4-c652f3585d32 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:16.384019 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-eb959fd7-dc09-41bd-89d3-b3b23081674e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:16.431079 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-eb959fd7-dc09-41bd-89d3-b3b23081674e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1221 microversion: 2.1 time: 0.653567 Jul 12 13:42:16.431705 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 8/18] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:15 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1221 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:16.845579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-77d75e1a-7339-49f0-be58-3cbde545641a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: .version_select at 0x7f3a160a4700>, body: {"keypair": {"name": "tempest-keypair-1679322499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2ZYDb5WjZx6BUXhNXmJgx7l65D/klep7HONaUM+6vCpmIKDezdDRLBPEhikB20mDGjcwdvNoLVlVvI2gJMBTXkxhFLL7oUkaj5E2FIqFxwwmYko5NyVVF7HEMjMf07YA=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:16.899218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-77d75e1a-7339-49f0-be58-3cbde545641a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for project c4e88457b140443093476f9b6d9bcff4. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:42:16.910118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-77d75e1a-7339-49f0-be58-3cbde545641a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for user a892b2511463404c818c63e870a23389 and project c4e88457b140443093476f9b6d9bcff4. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:42:17.010652 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-77d75e1a-7339-49f0-be58-3cbde545641a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.547365 Jul 12 13:42:17.012085 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 9/19] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jul 12 13:42:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:17.449787 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b34f7009-1eb8-487c-9301-10acdd797d12 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:17.458506 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b34f7009-1eb8-487c-9301-10acdd797d12 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:17.470080 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b34f7009-1eb8-487c-9301-10acdd797d12 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:17.477570 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b34f7009-1eb8-487c-9301-10acdd797d12 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:17.479763 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b34f7009-1eb8-487c-9301-10acdd797d12 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:17.481903 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b34f7009-1eb8-487c-9301-10acdd797d12 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:17.719669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b34f7009-1eb8-487c-9301-10acdd797d12 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:17.739417 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b34f7009-1eb8-487c-9301-10acdd797d12 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1217 microversion: 2.1 time: 0.293356 Jul 12 13:42:17.762865 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 10/20] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:17 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1217 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:17.935229 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-38fd1131-4b66-4387-9fab-5178e3bdebdc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Action: 'create', calling method: .version_select at 0x7f3a160f2940>, body: {"keypair": {"name": "tempest-keypair-110721601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO52/D3ChCEtvXLDxbsZCvnv261qJm9+Erd9e3ehVIbpsUztSbMnqB425wQ8Y4/P5fzbr/QnNkSUKNzhsr8trYldcHfaDFM9AIVNnIwvDTeTE6MWA2tETncbNT7qiRk+NA=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:18.022243 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-38fd1131-4b66-4387-9fab-5178e3bdebdc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Getting quotas for project e54281ff11484f77b0d20fd039ef938e. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:42:18.038822 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-38fd1131-4b66-4387-9fab-5178e3bdebdc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Getting quotas for user d9e5bc258de54fd6b3811401783a7408 and project e54281ff11484f77b0d20fd039ef938e. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:42:18.103597 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-38fd1131-4b66-4387-9fab-5178e3bdebdc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.339483 Jul 12 13:42:18.104469 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 11/21] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Jul 12 13:42:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 341 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 13:42:18.765217 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7c6e48c5-78d3-4ae4-8406-1b4806f1b8e0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:18.766563 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7c6e48c5-78d3-4ae4-8406-1b4806f1b8e0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:18.777051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7c6e48c5-78d3-4ae4-8406-1b4806f1b8e0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:18.779102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7c6e48c5-78d3-4ae4-8406-1b4806f1b8e0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:18.782345 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7c6e48c5-78d3-4ae4-8406-1b4806f1b8e0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:18.786607 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7c6e48c5-78d3-4ae4-8406-1b4806f1b8e0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:19.319414 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-352bbee9-f284-40b0-bfe4-c652f3585d32 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:19.334161 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-352bbee9-f284-40b0-bfe4-c652f3585d32 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 3.179302 Jul 12 13:42:19.336961 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 11/22] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:16 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 3183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:19.347670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:19.449424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7c6e48c5-78d3-4ae4-8406-1b4806f1b8e0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:19.471398 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7c6e48c5-78d3-4ae4-8406-1b4806f1b8e0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1279 microversion: 2.1 time: 0.716442 Jul 12 13:42:19.474456 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 12/23] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:18 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1279 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:20.354384 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-755576cf-3688-40a1-85fd-1bbca04edde0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:20.354991 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-755576cf-3688-40a1-85fd-1bbca04edde0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:20.370926 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-755576cf-3688-40a1-85fd-1bbca04edde0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:20.371364 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-755576cf-3688-40a1-85fd-1bbca04edde0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:20.390291 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-755576cf-3688-40a1-85fd-1bbca04edde0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:20.391839 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-755576cf-3688-40a1-85fd-1bbca04edde0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:20.492765 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bd7586cd-3e8a-4292-aac2-b040c5f3a16f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:20.494322 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bd7586cd-3e8a-4292-aac2-b040c5f3a16f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:20.523250 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bd7586cd-3e8a-4292-aac2-b040c5f3a16f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:20.540454 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bd7586cd-3e8a-4292-aac2-b040c5f3a16f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:20.544867 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bd7586cd-3e8a-4292-aac2-b040c5f3a16f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:20.545904 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bd7586cd-3e8a-4292-aac2-b040c5f3a16f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:21.568103 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bd7586cd-3e8a-4292-aac2-b040c5f3a16f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:21.583793 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bd7586cd-3e8a-4292-aac2-b040c5f3a16f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1279 microversion: 2.1 time: 1.091210 Jul 12 13:42:21.588161 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 13/24] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:20 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1279 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:22.590651 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-efb3b5b0-ae13-4c75-bf14-967e4a308d7a req-13b91e69-098b-4a71-9abd-cb25e342f5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89e1992-2407-4b9b-b805-2e68237ddc96", "tag": "4fe708d1-0106-46fa-a5fc-1441af3d9f78"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:22.631356 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-efb3b5b0-ae13-4c75-bf14-967e4a308d7a req-13b91e69-098b-4a71-9abd-cb25e342f5c4 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:22.632623 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-efb3b5b0-ae13-4c75-bf14-967e4a308d7a req-13b91e69-098b-4a71-9abd-cb25e342f5c4 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:22.702504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-755576cf-3688-40a1-85fd-1bbca04edde0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:22.716996 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-efb3b5b0-ae13-4c75-bf14-967e4a308d7a req-13b91e69-098b-4a71-9abd-cb25e342f5c4 service nova] Creating event network-changed:4fe708d1-0106-46fa-a5fc-1441af3d9f78 for instance b89e1992-2407-4b9b-b805-2e68237ddc96 on hv-cinder-79797 Jul 12 13:42:22.719142 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-efb3b5b0-ae13-4c75-bf14-967e4a308d7a req-13b91e69-098b-4a71-9abd-cb25e342f5c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124465) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 13:42:22.721378 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-201fa49b-47fe-4d2c-9273-2bf102dc71b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:22.726172 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-201fa49b-47fe-4d2c-9273-2bf102dc71b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:22.727388 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-201fa49b-47fe-4d2c-9273-2bf102dc71b1 None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:22.728756 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-201fa49b-47fe-4d2c-9273-2bf102dc71b1 None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:22.736554 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-755576cf-3688-40a1-85fd-1bbca04edde0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 2.386263 Jul 12 13:42:22.742991 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 12/25] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:20 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:22.748361 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-810b44bd-b599-4aac-b28c-4dac63935a97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:22.748977 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-810b44bd-b599-4aac-b28c-4dac63935a97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:22.757450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.compute.rpcapi [None req-201fa49b-47fe-4d2c-9273-2bf102dc71b1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 13:42:22.760687 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-201fa49b-47fe-4d2c-9273-2bf102dc71b1 None None] Releasing lock "compute-rpcapi-router" {{(pid=124465) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 13:42:22.779000 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-810b44bd-b599-4aac-b28c-4dac63935a97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:22.782719 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-810b44bd-b599-4aac-b28c-4dac63935a97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:22.784924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-810b44bd-b599-4aac-b28c-4dac63935a97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:22.785579 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-810b44bd-b599-4aac-b28c-4dac63935a97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:22.828620 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-201fa49b-47fe-4d2c-9273-2bf102dc71b1 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.385431 Jul 12 13:42:22.829666 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:23.004922 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-810b44bd-b599-4aac-b28c-4dac63935a97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:23.019466 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-810b44bd-b599-4aac-b28c-4dac63935a97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1279 microversion: 2.1 time: 0.274085 Jul 12 13:42:23.022669 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 13/27] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:22 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:23.761630 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-39125fcf-2e30-409a-8c40-74a9cf9492fc tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:23.762434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-39125fcf-2e30-409a-8c40-74a9cf9492fc tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:23.778234 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-39125fcf-2e30-409a-8c40-74a9cf9492fc tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:23.791594 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-39125fcf-2e30-409a-8c40-74a9cf9492fc tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:23.796974 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-39125fcf-2e30-409a-8c40-74a9cf9492fc tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:23.799703 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-39125fcf-2e30-409a-8c40-74a9cf9492fc tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:24.036630 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bf1bfb94-833b-4b57-a9bc-b27e95e710d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:24.037248 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bf1bfb94-833b-4b57-a9bc-b27e95e710d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:24.045978 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bf1bfb94-833b-4b57-a9bc-b27e95e710d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:24.046455 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bf1bfb94-833b-4b57-a9bc-b27e95e710d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:24.047201 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bf1bfb94-833b-4b57-a9bc-b27e95e710d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:24.047649 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bf1bfb94-833b-4b57-a9bc-b27e95e710d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:24.259724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-39125fcf-2e30-409a-8c40-74a9cf9492fc tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:24.268383 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-39125fcf-2e30-409a-8c40-74a9cf9492fc tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.511458 Jul 12 13:42:24.271220 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 15/28] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:23 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:24.647927 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1050532269", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f4c68ad-9819-4d39-b28a-d626c5d607bf"}], "security_groups": [{"name": "tempest-securitygroup--34743116"}], "key_name": "tempest-keypair-235067066", "user_data": "}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:25.424321 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:25.561754 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=18 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:25.572650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bf1bfb94-833b-4b57-a9bc-b27e95e710d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:25.585505 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bf1bfb94-833b-4b57-a9bc-b27e95e710d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 1.552593 Jul 12 13:42:25.586129 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 14/29] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:24 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:25.629775 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e6b1b26a-e94e-4f02-8d82-02812a19177c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:25.630473 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e6b1b26a-e94e-4f02-8d82-02812a19177c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:25.693209 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6b1b26a-e94e-4f02-8d82-02812a19177c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:25.694594 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6b1b26a-e94e-4f02-8d82-02812a19177c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:25.696595 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6b1b26a-e94e-4f02-8d82-02812a19177c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:25.698278 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6b1b26a-e94e-4f02-8d82-02812a19177c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:27.151352 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e6b1b26a-e94e-4f02-8d82-02812a19177c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:27.166188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e6b1b26a-e94e-4f02-8d82-02812a19177c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 1.552724 Jul 12 13:42:27.168910 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 15/30] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:25 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:27.181054 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-6c599d81-466d-4c3a-87a7-0a2775444bcc req-056fd2a9-9cd9-46ea-9838-d07c034a8daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bb10a9b-adfe-4578-82cc-c87fb34cbc33", "tag": "21198481-b443-4a4b-aef1-450d509835e7"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:27.227895 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-6c599d81-466d-4c3a-87a7-0a2775444bcc req-056fd2a9-9cd9-46ea-9838-d07c034a8daa service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:27.228342 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-6c599d81-466d-4c3a-87a7-0a2775444bcc req-056fd2a9-9cd9-46ea-9838-d07c034a8daa service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:27.293404 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-6c599d81-466d-4c3a-87a7-0a2775444bcc req-056fd2a9-9cd9-46ea-9838-d07c034a8daa service nova] Creating event network-changed:21198481-b443-4a4b-aef1-450d509835e7 for instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 on hv-cinder-79797 Jul 12 13:42:27.293914 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-6c599d81-466d-4c3a-87a7-0a2775444bcc req-056fd2a9-9cd9-46ea-9838-d07c034a8daa service nova] Acquired lock "compute-rpcapi-router" {{(pid=124466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 13:42:27.297176 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-946884f9-d027-4c15-8441-6bb4ab00277c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:27.299932 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-946884f9-d027-4c15-8441-6bb4ab00277c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:27.302417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-946884f9-d027-4c15-8441-6bb4ab00277c None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:27.304998 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-946884f9-d027-4c15-8441-6bb4ab00277c None None] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:27.338245 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.compute.rpcapi [None req-946884f9-d027-4c15-8441-6bb4ab00277c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 13:42:27.340505 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-946884f9-d027-4c15-8441-6bb4ab00277c None None] Releasing lock "compute-rpcapi-router" {{(pid=124466) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 13:42:27.385092 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-946884f9-d027-4c15-8441-6bb4ab00277c None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214741 Jul 12 13:42:27.386231 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:27.399765 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6d73d775-dcb2-4840-abd1-b70f02058de0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:27.401596 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6d73d775-dcb2-4840-abd1-b70f02058de0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:27.421740 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6d73d775-dcb2-4840-abd1-b70f02058de0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:27.422474 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6d73d775-dcb2-4840-abd1-b70f02058de0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:27.423699 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6d73d775-dcb2-4840-abd1-b70f02058de0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:27.424298 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6d73d775-dcb2-4840-abd1-b70f02058de0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:27.802690 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6d73d775-dcb2-4840-abd1-b70f02058de0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:27.824779 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6d73d775-dcb2-4840-abd1-b70f02058de0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.436364 Jul 12 13:42:27.836684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 17/32] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:27 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:28.062697 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=20 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:28.065370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-0376a1d1-e345-4eb0-8d9f-d0568df2bc3f req-2d913197-718e-4580-9285-aeeb40662719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd43000-7184-403f-b685-55b46308109a", "tag": "98f8baf2-5f9c-4979-978b-4e21a04f2087"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:28.079697 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-0376a1d1-e345-4eb0-8d9f-d0568df2bc3f req-2d913197-718e-4580-9285-aeeb40662719 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:28.085031 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-0376a1d1-e345-4eb0-8d9f-d0568df2bc3f req-2d913197-718e-4580-9285-aeeb40662719 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:28.123546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-0376a1d1-e345-4eb0-8d9f-d0568df2bc3f req-2d913197-718e-4580-9285-aeeb40662719 service nova] Creating event network-changed:98f8baf2-5f9c-4979-978b-4e21a04f2087 for instance 1cd43000-7184-403f-b685-55b46308109a on hv-cinder-79797 Jul 12 13:42:28.152546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-0376a1d1-e345-4eb0-8d9f-d0568df2bc3f req-2d913197-718e-4580-9285-aeeb40662719 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310210 Jul 12 13:42:28.155075 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 18/33] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:28.185510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8bc7cc5f-b574-438b-9fa1-a23183496b1d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:28.186495 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8bc7cc5f-b574-438b-9fa1-a23183496b1d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:28.199130 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8bc7cc5f-b574-438b-9fa1-a23183496b1d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:28.200285 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8bc7cc5f-b574-438b-9fa1-a23183496b1d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:28.203659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8bc7cc5f-b574-438b-9fa1-a23183496b1d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:28.204304 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8bc7cc5f-b574-438b-9fa1-a23183496b1d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:29.570906 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8bc7cc5f-b574-438b-9fa1-a23183496b1d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:29.579499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8bc7cc5f-b574-438b-9fa1-a23183496b1d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 1.397996 Jul 12 13:42:29.582858 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 19/34] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:28 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:29.596125 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-95c076e1-c00b-46f9-afa2-0d0e45cf9532 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:29.597154 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-95c076e1-c00b-46f9-afa2-0d0e45cf9532 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:29.604293 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-95c076e1-c00b-46f9-afa2-0d0e45cf9532 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:29.605119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-95c076e1-c00b-46f9-afa2-0d0e45cf9532 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:29.606331 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-95c076e1-c00b-46f9-afa2-0d0e45cf9532 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:29.607004 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-95c076e1-c00b-46f9-afa2-0d0e45cf9532 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:29.636302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.network.neutron [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] validate_networks() for [('8f4c68ad-9819-4d39-b28a-d626c5d607bf', None, None, None, None, None)] {{(pid=124465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:42:29.888985 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-95c076e1-c00b-46f9-afa2-0d0e45cf9532 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:29.898104 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-95c076e1-c00b-46f9-afa2-0d0e45cf9532 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.305559 Jul 12 13:42:29.908460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 20/35] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:29 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:29.984150 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1709066363", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b185d3e3-0515-4a5f-a4e6-7250d0186851"}], "security_groups": [{"name": "tempest-securitygroup--1629531527"}], "key_name": "tempest-keypair-110721601", "user_data": "}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:30.097103 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] validate_networks() for [('b185d3e3-0515-4a5f-a4e6-7250d0186851', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:42:30.300179 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Flavor limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:42:30.300613 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Image limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:42:30.301125 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Flavor pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:42:30.301543 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Image pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:42:30.301980 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:42:30.311943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:30.312398 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:30.313196 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:30.313637 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:30.330125 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Getting quotas for project 5f431e3ab50a4133916f6175a2ef1b4f. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:42:30.334360 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Getting quotas for user 2ad8ebe54a1d42eda9b23108f92a1d23 and project 5f431e3ab50a4133916f6175a2ef1b4f. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:42:30.345234 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Going to run 1 instances... {{(pid=124465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:42:30.347533 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:42:30.394603 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a1cb46f0-13b7-48e7-ad66-d2310d7ad445 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 5.751260 Jul 12 13:42:30.395243 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 16/36] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:42:24 2022] POST /compute/v2.1/servers => generated 400 bytes in 5753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 13:42:30.400738 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1418565751", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0de195dd-d448-4ed3-8684-a2fd07757acb"}], "security_groups": [{"name": "tempest-securitygroup--905331739"}], "key_name": "tempest-keypair-1679322499", "user_data": "}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:30.512234 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:42:30.512833 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:42:30.513448 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:42:30.513784 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:42:30.514234 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:42:30.525527 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:30.526027 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:30.526832 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:30.527319 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:30.543622 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.network.neutron [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] validate_networks() for [('0de195dd-d448-4ed3-8684-a2fd07757acb', None, None, None, None, None)] {{(pid=124465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:42:30.554699 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Getting quotas for project e54281ff11484f77b0d20fd039ef938e. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:42:30.558803 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Getting quotas for user d9e5bc258de54fd6b3811401783a7408 and project e54281ff11484f77b0d20fd039ef938e. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:42:30.578316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:42:30.593677 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:42:30.674010 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-87832fc0-3e9f-46b1-ba2d-696910b629dd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.693977 Jul 12 13:42:30.676737 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 21/37] 10.222.0.52 () {62 vars in 1187 bytes} [Tue Jul 12 13:42:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 12 13:42:30.685343 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5d2445f0-7823-4721-aa95-b971912fa77f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:30.694258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5d2445f0-7823-4721-aa95-b971912fa77f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:30.754770 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5d2445f0-7823-4721-aa95-b971912fa77f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:30.763247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5d2445f0-7823-4721-aa95-b971912fa77f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1237 microversion: 2.1 time: 0.085503 Jul 12 13:42:30.773977 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 22/38] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:30 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:30.779522 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-36afbd75-d3ea-45de-901b-c73d2f4e843c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:30.780149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-36afbd75-d3ea-45de-901b-c73d2f4e843c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:30.787711 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-36afbd75-d3ea-45de-901b-c73d2f4e843c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:30.788490 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-36afbd75-d3ea-45de-901b-c73d2f4e843c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:30.789493 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-36afbd75-d3ea-45de-901b-c73d2f4e843c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:30.790189 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-36afbd75-d3ea-45de-901b-c73d2f4e843c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:31.063856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-36afbd75-d3ea-45de-901b-c73d2f4e843c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:31.071944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-36afbd75-d3ea-45de-901b-c73d2f4e843c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.296191 Jul 12 13:42:31.072995 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 23/39] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:30 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:31.077604 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8be731eb-f6b6-49fa-99cb-354a41c4d6ce tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:31.078567 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8be731eb-f6b6-49fa-99cb-354a41c4d6ce tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:31.083989 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Flavor limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:42:31.085131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Image limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:42:31.085682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Flavor pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:42:31.086143 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Image pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:42:31.086589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:42:31.096561 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:31.097193 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:31.098049 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:31.098535 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:31.121871 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for project c4e88457b140443093476f9b6d9bcff4. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:42:31.125768 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for user a892b2511463404c818c63e870a23389 and project c4e88457b140443093476f9b6d9bcff4. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:42:31.128319 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:31.137008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8be731eb-f6b6-49fa-99cb-354a41c4d6ce tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:31.140650 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Going to run 1 instances... {{(pid=124465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:42:31.143149 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:42:31.144645 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8be731eb-f6b6-49fa-99cb-354a41c4d6ce tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:31.146418 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8be731eb-f6b6-49fa-99cb-354a41c4d6ce tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:31.147524 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8be731eb-f6b6-49fa-99cb-354a41c4d6ce tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1281 microversion: 2.20 time: 0.073616 Jul 12 13:42:31.148387 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 24/40] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:31 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:31.158024 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ffaef8b3-71e1-4b61-8370-7281e4147892 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:31.159017 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ffaef8b3-71e1-4b61-8370-7281e4147892 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:31.167004 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ffaef8b3-71e1-4b61-8370-7281e4147892 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:31.167563 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ffaef8b3-71e1-4b61-8370-7281e4147892 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:31.168490 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ffaef8b3-71e1-4b61-8370-7281e4147892 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:31.169238 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ffaef8b3-71e1-4b61-8370-7281e4147892 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:31.200970 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b5900a71-eb89-4d74-8937-b9b265ec3a04 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.803932 Jul 12 13:42:31.202225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 17/41] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:42:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:42:31.215246 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ea365ed5-545b-4693-b4e1-1f7bf62ba397 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:31.215871 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ea365ed5-545b-4693-b4e1-1f7bf62ba397 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:31.276533 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ea365ed5-545b-4693-b4e1-1f7bf62ba397 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:31.285201 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ea365ed5-545b-4693-b4e1-1f7bf62ba397 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1242 microversion: 2.1 time: 0.074071 Jul 12 13:42:31.285856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 18/42] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:31 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:31.344537 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ffaef8b3-71e1-4b61-8370-7281e4147892 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:31.352868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ffaef8b3-71e1-4b61-8370-7281e4147892 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.203297 Jul 12 13:42:31.353990 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 25/43] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:31 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:31.780385 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6edb2150-a9cf-4378-b855-464ee932a1ff tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:31.781000 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6edb2150-a9cf-4378-b855-464ee932a1ff tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:31.787095 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6edb2150-a9cf-4378-b855-464ee932a1ff tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:31.788081 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6edb2150-a9cf-4378-b855-464ee932a1ff tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:31.788847 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6edb2150-a9cf-4378-b855-464ee932a1ff tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:31.789292 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6edb2150-a9cf-4378-b855-464ee932a1ff tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:31.861816 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6edb2150-a9cf-4378-b855-464ee932a1ff tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:31.874378 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6edb2150-a9cf-4378-b855-464ee932a1ff tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1241 microversion: 2.1 time: 0.097628 Jul 12 13:42:31.875439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 19/44] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:31 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:32.090801 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ad250aa9-0a38-4012-bb49-58d38053aa22 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:32.091628 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ad250aa9-0a38-4012-bb49-58d38053aa22 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:32.094759 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:32.098774 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad250aa9-0a38-4012-bb49-58d38053aa22 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:32.099222 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad250aa9-0a38-4012-bb49-58d38053aa22 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:32.099974 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad250aa9-0a38-4012-bb49-58d38053aa22 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:32.100405 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad250aa9-0a38-4012-bb49-58d38053aa22 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:32.166305 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-255fad11-825b-44eb-9e43-70e7cec47980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:32.167499 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-255fad11-825b-44eb-9e43-70e7cec47980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:32.174453 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-255fad11-825b-44eb-9e43-70e7cec47980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:32.175244 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-255fad11-825b-44eb-9e43-70e7cec47980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:32.176235 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-255fad11-825b-44eb-9e43-70e7cec47980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:32.176820 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-255fad11-825b-44eb-9e43-70e7cec47980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:32.252550 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-255fad11-825b-44eb-9e43-70e7cec47980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:32.263919 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-255fad11-825b-44eb-9e43-70e7cec47980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:32.265624 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-255fad11-825b-44eb-9e43-70e7cec47980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:32.267156 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-255fad11-825b-44eb-9e43-70e7cec47980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1285 microversion: 2.20 time: 0.105959 Jul 12 13:42:32.268036 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 20/45] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:32 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:32.303836 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d497b8fb-cef3-429b-b5df-daacac32d63e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:32.304453 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d497b8fb-cef3-429b-b5df-daacac32d63e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:32.310667 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d497b8fb-cef3-429b-b5df-daacac32d63e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:32.311116 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d497b8fb-cef3-429b-b5df-daacac32d63e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:32.311887 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d497b8fb-cef3-429b-b5df-daacac32d63e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:32.312328 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d497b8fb-cef3-429b-b5df-daacac32d63e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:32.380004 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ad250aa9-0a38-4012-bb49-58d38053aa22 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:32.385122 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d497b8fb-cef3-429b-b5df-daacac32d63e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:32.388384 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ad250aa9-0a38-4012-bb49-58d38053aa22 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.302464 Jul 12 13:42:32.389186 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 26/46] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:32 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:32.394475 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3ef4fa0b-6909-4906-9c1d-842be695bea8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:32.395288 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3ef4fa0b-6909-4906-9c1d-842be695bea8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:32.397195 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d497b8fb-cef3-429b-b5df-daacac32d63e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1238 microversion: 2.1 time: 0.097919 Jul 12 13:42:32.398063 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 21/47] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:32 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:32.403288 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ef4fa0b-6909-4906-9c1d-842be695bea8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:32.403743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ef4fa0b-6909-4906-9c1d-842be695bea8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:32.404511 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ef4fa0b-6909-4906-9c1d-842be695bea8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:32.405111 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ef4fa0b-6909-4906-9c1d-842be695bea8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:32.535294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3ef4fa0b-6909-4906-9c1d-842be695bea8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:32.543440 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3ef4fa0b-6909-4906-9c1d-842be695bea8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.153089 Jul 12 13:42:32.544013 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 27/48] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:32 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:32.892478 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8a822bd1-d458-428c-a148-2ab4b3ad3043 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:32.893206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8a822bd1-d458-428c-a148-2ab4b3ad3043 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:32.899795 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a822bd1-d458-428c-a148-2ab4b3ad3043 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:32.900156 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a822bd1-d458-428c-a148-2ab4b3ad3043 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:32.900917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a822bd1-d458-428c-a148-2ab4b3ad3043 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:32.901382 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a822bd1-d458-428c-a148-2ab4b3ad3043 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:32.973752 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8a822bd1-d458-428c-a148-2ab4b3ad3043 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:32.981844 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8a822bd1-d458-428c-a148-2ab4b3ad3043 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1233 microversion: 2.1 time: 0.093516 Jul 12 13:42:32.982440 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 22/49] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:32 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1233 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:33.285650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0aaba57d-5571-475f-aa19-ecacaa07f42a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:33.286288 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0aaba57d-5571-475f-aa19-ecacaa07f42a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:33.292906 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0aaba57d-5571-475f-aa19-ecacaa07f42a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:33.293359 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0aaba57d-5571-475f-aa19-ecacaa07f42a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:33.294148 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0aaba57d-5571-475f-aa19-ecacaa07f42a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:33.294589 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0aaba57d-5571-475f-aa19-ecacaa07f42a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:33.312362 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:33.359191 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0aaba57d-5571-475f-aa19-ecacaa07f42a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:33.367073 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0aaba57d-5571-475f-aa19-ecacaa07f42a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:33.368601 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0aaba57d-5571-475f-aa19-ecacaa07f42a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:33.369690 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0aaba57d-5571-475f-aa19-ecacaa07f42a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1277 microversion: 2.20 time: 0.088093 Jul 12 13:42:33.370276 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 28/50] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:33 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:33.406036 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-364bda72-56bd-4f02-877e-e52184428ffd tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:33.406651 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-364bda72-56bd-4f02-877e-e52184428ffd tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:33.413951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-86752215-db41-4d79-9928-1c50f9bc85d4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:33.414939 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-86752215-db41-4d79-9928-1c50f9bc85d4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:33.420960 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-86752215-db41-4d79-9928-1c50f9bc85d4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:33.421421 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-86752215-db41-4d79-9928-1c50f9bc85d4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:33.422210 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-86752215-db41-4d79-9928-1c50f9bc85d4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:33.422652 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-86752215-db41-4d79-9928-1c50f9bc85d4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:33.425435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-364bda72-56bd-4f02-877e-e52184428ffd tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:33.425904 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-364bda72-56bd-4f02-877e-e52184428ffd tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:33.426694 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-364bda72-56bd-4f02-877e-e52184428ffd tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:33.427132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-364bda72-56bd-4f02-877e-e52184428ffd tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:33.488715 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-86752215-db41-4d79-9928-1c50f9bc85d4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:33.496167 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-86752215-db41-4d79-9928-1c50f9bc85d4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1238 microversion: 2.1 time: 0.086072 Jul 12 13:42:33.496735 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 29/51] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:33 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:33.558964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-364bda72-56bd-4f02-877e-e52184428ffd tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:33.560190 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-eb3a7d86-7860-4283-9df6-acf7c2190981 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:33.560802 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-eb3a7d86-7860-4283-9df6-acf7c2190981 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:33.566590 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-364bda72-56bd-4f02-877e-e52184428ffd tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.164435 Jul 12 13:42:33.566880 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d86-7860-4283-9df6-acf7c2190981 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:33.567180 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 23/52] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:33 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:33.567349 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d86-7860-4283-9df6-acf7c2190981 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:33.568717 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d86-7860-4283-9df6-acf7c2190981 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:33.569151 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eb3a7d86-7860-4283-9df6-acf7c2190981 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:33.700034 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-eb3a7d86-7860-4283-9df6-acf7c2190981 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:33.707347 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-eb3a7d86-7860-4283-9df6-acf7c2190981 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.150945 Jul 12 13:42:33.708074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 30/53] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:33 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:33.999362 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-111a9f3d-ea51-47e9-9bc0-11806f4edfcb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:34.000260 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-111a9f3d-ea51-47e9-9bc0-11806f4edfcb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:34.007148 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-111a9f3d-ea51-47e9-9bc0-11806f4edfcb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:34.007606 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-111a9f3d-ea51-47e9-9bc0-11806f4edfcb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:34.008379 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-111a9f3d-ea51-47e9-9bc0-11806f4edfcb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:34.008820 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-111a9f3d-ea51-47e9-9bc0-11806f4edfcb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:34.011461 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=77 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:34.069994 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-111a9f3d-ea51-47e9-9bc0-11806f4edfcb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:34.077855 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-111a9f3d-ea51-47e9-9bc0-11806f4edfcb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1233 microversion: 2.1 time: 0.082228 Jul 12 13:42:34.087199 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 24/54] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:33 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1233 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:34.387872 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-09011e48-4f30-4525-ac02-6412358dca3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:34.388523 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-09011e48-4f30-4525-ac02-6412358dca3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:34.394530 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09011e48-4f30-4525-ac02-6412358dca3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:34.394975 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09011e48-4f30-4525-ac02-6412358dca3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:34.395754 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09011e48-4f30-4525-ac02-6412358dca3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:34.396186 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09011e48-4f30-4525-ac02-6412358dca3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:34.457622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-09011e48-4f30-4525-ac02-6412358dca3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:34.466156 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-09011e48-4f30-4525-ac02-6412358dca3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:34.467724 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-09011e48-4f30-4525-ac02-6412358dca3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:34.468884 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-09011e48-4f30-4525-ac02-6412358dca3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1277 microversion: 2.20 time: 0.084885 Jul 12 13:42:34.469437 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 31/55] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:34 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:34.512592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3c9bd57c-d57d-4fe3-8090-658d72c2c7ee tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:34.513215 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3c9bd57c-d57d-4fe3-8090-658d72c2c7ee tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:34.519186 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c9bd57c-d57d-4fe3-8090-658d72c2c7ee tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:34.519645 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c9bd57c-d57d-4fe3-8090-658d72c2c7ee tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:34.520409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c9bd57c-d57d-4fe3-8090-658d72c2c7ee tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:34.520852 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c9bd57c-d57d-4fe3-8090-658d72c2c7ee tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:34.580018 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3c9bd57c-d57d-4fe3-8090-658d72c2c7ee tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:34.585120 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-400a1cd6-1ef3-417a-81a1-c87102b30424 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:34.585730 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-400a1cd6-1ef3-417a-81a1-c87102b30424 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:34.588002 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3c9bd57c-d57d-4fe3-8090-658d72c2c7ee tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1238 microversion: 2.1 time: 0.079311 Jul 12 13:42:34.588704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 25/56] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:34 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:34.591809 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-400a1cd6-1ef3-417a-81a1-c87102b30424 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:34.592254 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-400a1cd6-1ef3-417a-81a1-c87102b30424 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:34.593021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-400a1cd6-1ef3-417a-81a1-c87102b30424 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:34.593458 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-400a1cd6-1ef3-417a-81a1-c87102b30424 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:34.718461 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-400a1cd6-1ef3-417a-81a1-c87102b30424 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:34.723924 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-cd043c28-8232-4859-a3a3-045c6d505aa9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:34.725157 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-cd043c28-8232-4859-a3a3-045c6d505aa9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:34.726645 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-400a1cd6-1ef3-417a-81a1-c87102b30424 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.145865 Jul 12 13:42:34.727217 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 32/57] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:34 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:34.731443 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd043c28-8232-4859-a3a3-045c6d505aa9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:34.731900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd043c28-8232-4859-a3a3-045c6d505aa9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:34.732685 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd043c28-8232-4859-a3a3-045c6d505aa9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:34.733110 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd043c28-8232-4859-a3a3-045c6d505aa9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:34.861037 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-cd043c28-8232-4859-a3a3-045c6d505aa9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:34.868368 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-cd043c28-8232-4859-a3a3-045c6d505aa9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.148234 Jul 12 13:42:34.868929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 26/58] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:34 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:35.094780 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-dff9fa84-e02c-4c87-a518-d107f4236808 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:35.095391 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-dff9fa84-e02c-4c87-a518-d107f4236808 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:35.101431 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dff9fa84-e02c-4c87-a518-d107f4236808 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:35.101903 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dff9fa84-e02c-4c87-a518-d107f4236808 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:35.102688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dff9fa84-e02c-4c87-a518-d107f4236808 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:35.103134 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dff9fa84-e02c-4c87-a518-d107f4236808 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:35.163056 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-dff9fa84-e02c-4c87-a518-d107f4236808 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:35.170993 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-dff9fa84-e02c-4c87-a518-d107f4236808 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1233 microversion: 2.1 time: 0.080149 Jul 12 13:42:35.171576 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 33/59] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:35 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1233 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:35.487246 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ae7caa47-c304-4507-9bbe-436f34c9d7ad tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:35.487986 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ae7caa47-c304-4507-9bbe-436f34c9d7ad tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:35.495252 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae7caa47-c304-4507-9bbe-436f34c9d7ad tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:35.495784 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae7caa47-c304-4507-9bbe-436f34c9d7ad tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:35.496595 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae7caa47-c304-4507-9bbe-436f34c9d7ad tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:35.497022 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae7caa47-c304-4507-9bbe-436f34c9d7ad tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:35.566290 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ae7caa47-c304-4507-9bbe-436f34c9d7ad tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:35.575568 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ae7caa47-c304-4507-9bbe-436f34c9d7ad tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:35.577118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ae7caa47-c304-4507-9bbe-436f34c9d7ad tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:35.578436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ae7caa47-c304-4507-9bbe-436f34c9d7ad tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1277 microversion: 2.20 time: 0.095258 Jul 12 13:42:35.579283 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 27/60] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:35 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:35.604869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2ddd42ea-1044-44cc-a02c-be920fb0fa00 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:35.605488 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2ddd42ea-1044-44cc-a02c-be920fb0fa00 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:35.611943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2ddd42ea-1044-44cc-a02c-be920fb0fa00 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:35.612388 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2ddd42ea-1044-44cc-a02c-be920fb0fa00 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:35.613155 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2ddd42ea-1044-44cc-a02c-be920fb0fa00 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:35.613592 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2ddd42ea-1044-44cc-a02c-be920fb0fa00 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:35.674268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2ddd42ea-1044-44cc-a02c-be920fb0fa00 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:35.682247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2ddd42ea-1044-44cc-a02c-be920fb0fa00 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1238 microversion: 2.1 time: 0.081186 Jul 12 13:42:35.682856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 34/61] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:35 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:35.744281 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b4def60f-bc2b-420c-bbf0-c39f0c328573 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:35.744943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b4def60f-bc2b-420c-bbf0-c39f0c328573 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:35.750856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b4def60f-bc2b-420c-bbf0-c39f0c328573 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:35.751302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b4def60f-bc2b-420c-bbf0-c39f0c328573 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:35.752358 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b4def60f-bc2b-420c-bbf0-c39f0c328573 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:35.752795 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b4def60f-bc2b-420c-bbf0-c39f0c328573 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:35.887314 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-671013ea-4aed-40ec-ac10-7035923ef6c4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:35.887994 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-671013ea-4aed-40ec-ac10-7035923ef6c4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:35.894625 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-671013ea-4aed-40ec-ac10-7035923ef6c4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:35.895086 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-671013ea-4aed-40ec-ac10-7035923ef6c4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:35.895869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-671013ea-4aed-40ec-ac10-7035923ef6c4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:35.896313 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b4def60f-bc2b-420c-bbf0-c39f0c328573 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:35.896451 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-671013ea-4aed-40ec-ac10-7035923ef6c4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:35.904152 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b4def60f-bc2b-420c-bbf0-c39f0c328573 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.164497 Jul 12 13:42:35.904727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 28/62] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:35 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:36.041766 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-671013ea-4aed-40ec-ac10-7035923ef6c4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:36.049423 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-671013ea-4aed-40ec-ac10-7035923ef6c4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.166618 Jul 12 13:42:36.050190 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 35/63] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:35 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:36.188614 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6d188124-4dc5-47a0-bceb-abe78eacdc51 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:36.189181 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6d188124-4dc5-47a0-bceb-abe78eacdc51 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:36.195344 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d188124-4dc5-47a0-bceb-abe78eacdc51 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:36.195803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d188124-4dc5-47a0-bceb-abe78eacdc51 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:36.196567 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d188124-4dc5-47a0-bceb-abe78eacdc51 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:36.197012 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d188124-4dc5-47a0-bceb-abe78eacdc51 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:36.258733 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6d188124-4dc5-47a0-bceb-abe78eacdc51 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:36.267608 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6d188124-4dc5-47a0-bceb-abe78eacdc51 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1233 microversion: 2.1 time: 0.082805 Jul 12 13:42:36.268451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 29/64] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:36 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1233 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:36.596407 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-07a2e3d3-0a3f-4d84-97fd-dac5c09a5fe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:36.597019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-07a2e3d3-0a3f-4d84-97fd-dac5c09a5fe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:36.602986 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07a2e3d3-0a3f-4d84-97fd-dac5c09a5fe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:36.603437 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07a2e3d3-0a3f-4d84-97fd-dac5c09a5fe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:36.604199 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07a2e3d3-0a3f-4d84-97fd-dac5c09a5fe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:36.604637 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07a2e3d3-0a3f-4d84-97fd-dac5c09a5fe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:36.665279 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-07a2e3d3-0a3f-4d84-97fd-dac5c09a5fe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:36.673279 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-07a2e3d3-0a3f-4d84-97fd-dac5c09a5fe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:36.674895 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-07a2e3d3-0a3f-4d84-97fd-dac5c09a5fe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:36.676086 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-07a2e3d3-0a3f-4d84-97fd-dac5c09a5fe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1277 microversion: 2.20 time: 0.083508 Jul 12 13:42:36.676639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 36/65] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:36 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:36.699595 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b62b3e39-5862-42f5-825b-1782426bb7a2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:36.700192 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b62b3e39-5862-42f5-825b-1782426bb7a2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:36.709661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b62b3e39-5862-42f5-825b-1782426bb7a2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:36.710027 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b62b3e39-5862-42f5-825b-1782426bb7a2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:36.710797 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b62b3e39-5862-42f5-825b-1782426bb7a2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:36.711237 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b62b3e39-5862-42f5-825b-1782426bb7a2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:36.783000 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b62b3e39-5862-42f5-825b-1782426bb7a2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:36.792550 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b62b3e39-5862-42f5-825b-1782426bb7a2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1238 microversion: 2.1 time: 0.096528 Jul 12 13:42:36.793150 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 30/66] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:36 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:36.921695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bec71b1d-400a-40f5-9fff-5dd0fa1e00c2 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:36.922332 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bec71b1d-400a-40f5-9fff-5dd0fa1e00c2 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:36.928880 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bec71b1d-400a-40f5-9fff-5dd0fa1e00c2 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:36.929335 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bec71b1d-400a-40f5-9fff-5dd0fa1e00c2 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:36.930138 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bec71b1d-400a-40f5-9fff-5dd0fa1e00c2 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:36.930577 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bec71b1d-400a-40f5-9fff-5dd0fa1e00c2 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:37.065548 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-dc52801f-33e3-47c1-ae4e-ef86151dc5fc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:37.066227 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-dc52801f-33e3-47c1-ae4e-ef86151dc5fc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:37.071019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bec71b1d-400a-40f5-9fff-5dd0fa1e00c2 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:37.073058 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dc52801f-33e3-47c1-ae4e-ef86151dc5fc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:37.073793 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dc52801f-33e3-47c1-ae4e-ef86151dc5fc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:37.074618 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dc52801f-33e3-47c1-ae4e-ef86151dc5fc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:37.075616 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dc52801f-33e3-47c1-ae4e-ef86151dc5fc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:37.079506 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bec71b1d-400a-40f5-9fff-5dd0fa1e00c2 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.161570 Jul 12 13:42:37.086732 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 37/67] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:36 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:37.220719 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-dc52801f-33e3-47c1-ae4e-ef86151dc5fc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:37.228778 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-dc52801f-33e3-47c1-ae4e-ef86151dc5fc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.167014 Jul 12 13:42:37.229276 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 31/68] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:37 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:37.284759 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4d4616b3-ef22-4dda-8045-4c77e5f41a1d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:37.287352 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4d4616b3-ef22-4dda-8045-4c77e5f41a1d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:37.296251 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d4616b3-ef22-4dda-8045-4c77e5f41a1d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:37.296833 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d4616b3-ef22-4dda-8045-4c77e5f41a1d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:37.298362 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d4616b3-ef22-4dda-8045-4c77e5f41a1d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:37.299082 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d4616b3-ef22-4dda-8045-4c77e5f41a1d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:37.368344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4d4616b3-ef22-4dda-8045-4c77e5f41a1d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:37.388581 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4d4616b3-ef22-4dda-8045-4c77e5f41a1d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1233 microversion: 2.1 time: 0.107632 Jul 12 13:42:37.395412 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 38/69] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:37 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1233 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:37.696213 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c40d3592-aa26-4a95-abca-92eb999fa69f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:37.696836 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c40d3592-aa26-4a95-abca-92eb999fa69f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:37.705441 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c40d3592-aa26-4a95-abca-92eb999fa69f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:37.706038 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c40d3592-aa26-4a95-abca-92eb999fa69f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:37.706700 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c40d3592-aa26-4a95-abca-92eb999fa69f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:37.707139 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c40d3592-aa26-4a95-abca-92eb999fa69f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:37.820445 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c40d3592-aa26-4a95-abca-92eb999fa69f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:37.827935 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7c0f1d35-6ca2-4a3c-bc7d-48de49aad947 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:37.827935 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7c0f1d35-6ca2-4a3c-bc7d-48de49aad947 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:37.837658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c0f1d35-6ca2-4a3c-bc7d-48de49aad947 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:37.838141 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c0f1d35-6ca2-4a3c-bc7d-48de49aad947 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:37.862384 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c40d3592-aa26-4a95-abca-92eb999fa69f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:37.862668 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c0f1d35-6ca2-4a3c-bc7d-48de49aad947 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:37.865117 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c0f1d35-6ca2-4a3c-bc7d-48de49aad947 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:37.867398 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c40d3592-aa26-4a95-abca-92eb999fa69f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:37.871185 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c40d3592-aa26-4a95-abca-92eb999fa69f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1333 microversion: 2.20 time: 0.177582 Jul 12 13:42:37.883682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 32/70] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:37 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1333 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:42:37.985540 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7c0f1d35-6ca2-4a3c-bc7d-48de49aad947 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:37.993684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7c0f1d35-6ca2-4a3c-bc7d-48de49aad947 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1294 microversion: 2.1 time: 0.180101 Jul 12 13:42:37.994829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 39/71] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:37 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1294 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:38.097460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4b3df011-9b31-467e-9b8b-d5379e7af0b3 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:38.098114 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4b3df011-9b31-467e-9b8b-d5379e7af0b3 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:38.106447 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b3df011-9b31-467e-9b8b-d5379e7af0b3 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:38.107032 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b3df011-9b31-467e-9b8b-d5379e7af0b3 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:38.107940 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b3df011-9b31-467e-9b8b-d5379e7af0b3 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:38.108402 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b3df011-9b31-467e-9b8b-d5379e7af0b3 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:38.246337 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2cdd3997-be4c-4a15-adf2-cf5ed6782728 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:38.247239 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2cdd3997-be4c-4a15-adf2-cf5ed6782728 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:38.254837 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2cdd3997-be4c-4a15-adf2-cf5ed6782728 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:38.255521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2cdd3997-be4c-4a15-adf2-cf5ed6782728 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:38.256546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2cdd3997-be4c-4a15-adf2-cf5ed6782728 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:38.257627 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2cdd3997-be4c-4a15-adf2-cf5ed6782728 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:38.282088 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4b3df011-9b31-467e-9b8b-d5379e7af0b3 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:38.302554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4b3df011-9b31-467e-9b8b-d5379e7af0b3 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.209651 Jul 12 13:42:38.303160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 33/72] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:38 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:38.405445 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-9f7246ab-dfe2-4fe9-8d15-2bae040bbcdf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:38.406101 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-9f7246ab-dfe2-4fe9-8d15-2bae040bbcdf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:38.415491 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9f7246ab-dfe2-4fe9-8d15-2bae040bbcdf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:38.416244 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9f7246ab-dfe2-4fe9-8d15-2bae040bbcdf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:38.417701 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9f7246ab-dfe2-4fe9-8d15-2bae040bbcdf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:38.418221 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9f7246ab-dfe2-4fe9-8d15-2bae040bbcdf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:38.519937 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-9f7246ab-dfe2-4fe9-8d15-2bae040bbcdf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:38.533189 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-9f7246ab-dfe2-4fe9-8d15-2bae040bbcdf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1297 microversion: 2.1 time: 0.131968 Jul 12 13:42:38.533886 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 34/73] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:38 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1297 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:38.897372 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4250a3ab-10b1-4b11-a1ef-649ee13c3d41 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:38.899518 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4250a3ab-10b1-4b11-a1ef-649ee13c3d41 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:38.910035 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4250a3ab-10b1-4b11-a1ef-649ee13c3d41 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:38.911695 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4250a3ab-10b1-4b11-a1ef-649ee13c3d41 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:38.913116 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4250a3ab-10b1-4b11-a1ef-649ee13c3d41 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:38.913866 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4250a3ab-10b1-4b11-a1ef-649ee13c3d41 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:39.009902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2cdd3997-be4c-4a15-adf2-cf5ed6782728 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:39.034490 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2cdd3997-be4c-4a15-adf2-cf5ed6782728 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.792834 Jul 12 13:42:39.035092 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 40/74] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:38 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:39.043580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4250a3ab-10b1-4b11-a1ef-649ee13c3d41 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:39.051447 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-93ec6d02-5c10-4198-8f3d-9e41e3e03bf7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:39.056804 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-93ec6d02-5c10-4198-8f3d-9e41e3e03bf7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:39.064119 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4250a3ab-10b1-4b11-a1ef-649ee13c3d41 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:39.064445 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93ec6d02-5c10-4198-8f3d-9e41e3e03bf7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:39.065052 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93ec6d02-5c10-4198-8f3d-9e41e3e03bf7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:39.066023 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93ec6d02-5c10-4198-8f3d-9e41e3e03bf7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:39.066618 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93ec6d02-5c10-4198-8f3d-9e41e3e03bf7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:39.072792 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4250a3ab-10b1-4b11-a1ef-649ee13c3d41 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:39.074438 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4250a3ab-10b1-4b11-a1ef-649ee13c3d41 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1339 microversion: 2.20 time: 0.186844 Jul 12 13:42:39.078312 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 35/75] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:38 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:42:39.272870 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-93ec6d02-5c10-4198-8f3d-9e41e3e03bf7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:39.280816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-93ec6d02-5c10-4198-8f3d-9e41e3e03bf7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1312 microversion: 2.1 time: 0.240530 Jul 12 13:42:39.282016 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 41/76] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:39 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1312 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:39.319813 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-189cec3d-0c4b-408f-ad22-0efa8103631a tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:39.320661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-189cec3d-0c4b-408f-ad22-0efa8103631a tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:39.328442 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-189cec3d-0c4b-408f-ad22-0efa8103631a tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:39.328896 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-189cec3d-0c4b-408f-ad22-0efa8103631a tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:39.331193 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-189cec3d-0c4b-408f-ad22-0efa8103631a tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:39.331806 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-189cec3d-0c4b-408f-ad22-0efa8103631a tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:39.551180 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e6c07c65-ffac-497c-8271-c60c84e9f2b2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:39.552073 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e6c07c65-ffac-497c-8271-c60c84e9f2b2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:39.559088 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6c07c65-ffac-497c-8271-c60c84e9f2b2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:39.559884 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6c07c65-ffac-497c-8271-c60c84e9f2b2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:39.560813 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6c07c65-ffac-497c-8271-c60c84e9f2b2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:39.561401 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e6c07c65-ffac-497c-8271-c60c84e9f2b2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:39.609175 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-189cec3d-0c4b-408f-ad22-0efa8103631a tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:39.641380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-189cec3d-0c4b-408f-ad22-0efa8103631a tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.308501 Jul 12 13:42:39.653798 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 36/77] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:39 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:39.955465 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e6c07c65-ffac-497c-8271-c60c84e9f2b2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:39.965656 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e6c07c65-ffac-497c-8271-c60c84e9f2b2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1295 microversion: 2.1 time: 0.418286 Jul 12 13:42:39.969113 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 42/78] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:39 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1295 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:40.051705 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ff206b35-e2da-49f3-8cce-599ab29d8b2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:40.052316 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ff206b35-e2da-49f3-8cce-599ab29d8b2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:40.060057 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ff206b35-e2da-49f3-8cce-599ab29d8b2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:40.060518 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ff206b35-e2da-49f3-8cce-599ab29d8b2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:40.061289 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ff206b35-e2da-49f3-8cce-599ab29d8b2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:40.061788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ff206b35-e2da-49f3-8cce-599ab29d8b2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:40.094801 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9eee255e-32c3-4a97-8df5-67f6b7ffc31b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:40.096867 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9eee255e-32c3-4a97-8df5-67f6b7ffc31b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:40.110867 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9eee255e-32c3-4a97-8df5-67f6b7ffc31b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:40.115620 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9eee255e-32c3-4a97-8df5-67f6b7ffc31b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:40.116673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9eee255e-32c3-4a97-8df5-67f6b7ffc31b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:40.120264 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9eee255e-32c3-4a97-8df5-67f6b7ffc31b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:40.344430 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9eee255e-32c3-4a97-8df5-67f6b7ffc31b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:40.356224 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9eee255e-32c3-4a97-8df5-67f6b7ffc31b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:40.360501 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9eee255e-32c3-4a97-8df5-67f6b7ffc31b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:40.369049 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9eee255e-32c3-4a97-8df5-67f6b7ffc31b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1339 microversion: 2.20 time: 0.274388 Jul 12 13:42:40.370494 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 43/79] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:40 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1339 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:40.386644 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-91270851-25e8-473c-ac6f-bac9be699fe0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:40.387953 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-91270851-25e8-473c-ac6f-bac9be699fe0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:40.398779 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91270851-25e8-473c-ac6f-bac9be699fe0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:40.402552 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91270851-25e8-473c-ac6f-bac9be699fe0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:40.403656 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91270851-25e8-473c-ac6f-bac9be699fe0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:40.404308 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91270851-25e8-473c-ac6f-bac9be699fe0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:40.457438 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ff206b35-e2da-49f3-8cce-599ab29d8b2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:40.474119 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ff206b35-e2da-49f3-8cce-599ab29d8b2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.421847 Jul 12 13:42:40.475218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 37/80] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:40 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:40.545406 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:40.628223 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-91270851-25e8-473c-ac6f-bac9be699fe0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:40.637870 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-91270851-25e8-473c-ac6f-bac9be699fe0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1300 microversion: 2.1 time: 0.263973 Jul 12 13:42:40.639000 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 44/81] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:40 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1300 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:40.662392 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-89b596c5-9f01-4950-9e07-0753dec66d8d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:40.663437 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-89b596c5-9f01-4950-9e07-0753dec66d8d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:40.685060 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-89b596c5-9f01-4950-9e07-0753dec66d8d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:40.685616 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-89b596c5-9f01-4950-9e07-0753dec66d8d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:40.686513 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-89b596c5-9f01-4950-9e07-0753dec66d8d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:40.687271 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-89b596c5-9f01-4950-9e07-0753dec66d8d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:40.697920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:40.700274 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-c0f0dfce-fd0d-4957-8d5f-03b7606a9c48 req-70483118-ad1b-4057-9de3-2c229e310bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd43000-7184-403f-b685-55b46308109a", "name": "network-vif-plugged", "status": "completed", "tag": "98f8baf2-5f9c-4979-978b-4e21a04f2087"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:40.713033 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-c0f0dfce-fd0d-4957-8d5f-03b7606a9c48 req-70483118-ad1b-4057-9de3-2c229e310bfd service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:40.713767 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-c0f0dfce-fd0d-4957-8d5f-03b7606a9c48 req-70483118-ad1b-4057-9de3-2c229e310bfd service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:40.728904 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-c0f0dfce-fd0d-4957-8d5f-03b7606a9c48 req-70483118-ad1b-4057-9de3-2c229e310bfd service nova] Creating event network-vif-plugged:98f8baf2-5f9c-4979-978b-4e21a04f2087 for instance 1cd43000-7184-403f-b685-55b46308109a on hv-cinder-79797 Jul 12 13:42:40.735846 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-c0f0dfce-fd0d-4957-8d5f-03b7606a9c48 req-70483118-ad1b-4057-9de3-2c229e310bfd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257030 Jul 12 13:42:40.737054 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 38/82] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:40.987787 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bafaa585-c001-441a-8854-49dbd3679762 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:40.988735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bafaa585-c001-441a-8854-49dbd3679762 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:41.004491 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bafaa585-c001-441a-8854-49dbd3679762 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:41.004949 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bafaa585-c001-441a-8854-49dbd3679762 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:41.005780 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bafaa585-c001-441a-8854-49dbd3679762 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:41.006549 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bafaa585-c001-441a-8854-49dbd3679762 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:41.108519 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=6 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:41.141496 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=10 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:41.284374 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=14 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:41.319712 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bafaa585-c001-441a-8854-49dbd3679762 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:41.329068 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bafaa585-c001-441a-8854-49dbd3679762 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.346391 Jul 12 13:42:41.350202 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 39/83] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:40 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:41.393313 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b6a36885-0499-4ed0-80ba-99e8ada86c2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:41.393940 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b6a36885-0499-4ed0-80ba-99e8ada86c2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:41.405474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6a36885-0499-4ed0-80ba-99e8ada86c2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:41.405926 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6a36885-0499-4ed0-80ba-99e8ada86c2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:41.411193 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6a36885-0499-4ed0-80ba-99e8ada86c2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:41.411651 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6a36885-0499-4ed0-80ba-99e8ada86c2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:41.731747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-89b596c5-9f01-4950-9e07-0753dec66d8d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:41.745887 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-89b596c5-9f01-4950-9e07-0753dec66d8d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 1.089637 Jul 12 13:42:41.750677 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 45/84] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:40 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:41.767019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0b6ea1fa-e935-416c-b8d8-e913fca4800b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:41.767669 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0b6ea1fa-e935-416c-b8d8-e913fca4800b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:41.780932 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0b6ea1fa-e935-416c-b8d8-e913fca4800b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:41.781680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0b6ea1fa-e935-416c-b8d8-e913fca4800b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:41.784915 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0b6ea1fa-e935-416c-b8d8-e913fca4800b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:41.785566 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0b6ea1fa-e935-416c-b8d8-e913fca4800b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:41.800597 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b6a36885-0499-4ed0-80ba-99e8ada86c2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:41.813162 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b6a36885-0499-4ed0-80ba-99e8ada86c2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:41.820357 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b6a36885-0499-4ed0-80ba-99e8ada86c2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:41.822728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b6a36885-0499-4ed0-80ba-99e8ada86c2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.434050 Jul 12 13:42:41.824871 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 40/85] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:41 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:41.841284 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d8d3fa42-645c-4b12-acec-470fa51cba6a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:41.842301 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d8d3fa42-645c-4b12-acec-470fa51cba6a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:41.856932 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d8d3fa42-645c-4b12-acec-470fa51cba6a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:41.857390 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d8d3fa42-645c-4b12-acec-470fa51cba6a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:41.858349 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d8d3fa42-645c-4b12-acec-470fa51cba6a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:41.858791 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d8d3fa42-645c-4b12-acec-470fa51cba6a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:41.891607 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=100 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:42.252981 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0b6ea1fa-e935-416c-b8d8-e913fca4800b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:42.253535 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d8d3fa42-645c-4b12-acec-470fa51cba6a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:42.262748 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d8d3fa42-645c-4b12-acec-470fa51cba6a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.435944 Jul 12 13:42:42.263342 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 41/86] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:41 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:42.269663 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-e4941fd6-3db4-4b9e-ada9-9151419ec65c req-13c6ea18-eab3-4dac-9093-f35940210d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56b0cff6-7efa-4a5b-bcfa-e9e435a77da9", "tag": "4596e2d0-f0f2-49b9-a0a8-ab69ee88ab56"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:42.280936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-e4941fd6-3db4-4b9e-ada9-9151419ec65c req-13c6ea18-eab3-4dac-9093-f35940210d96 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:42.281617 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0b6ea1fa-e935-416c-b8d8-e913fca4800b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.529315 Jul 12 13:42:42.282248 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 46/87] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:41 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:42.292798 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-e4941fd6-3db4-4b9e-ada9-9151419ec65c req-13c6ea18-eab3-4dac-9093-f35940210d96 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:42.339436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-e4941fd6-3db4-4b9e-ada9-9151419ec65c req-13c6ea18-eab3-4dac-9093-f35940210d96 service nova] Creating event network-changed:4596e2d0-f0f2-49b9-a0a8-ab69ee88ab56 for instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 on hv-cinder-79797 Jul 12 13:42:42.347272 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f264910b-8b29-4fc7-bd00-51b22ca2dd68 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:42.347887 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f264910b-8b29-4fc7-bd00-51b22ca2dd68 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:42.355979 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f264910b-8b29-4fc7-bd00-51b22ca2dd68 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:42.361018 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f264910b-8b29-4fc7-bd00-51b22ca2dd68 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:42.366909 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f264910b-8b29-4fc7-bd00-51b22ca2dd68 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:42.367422 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f264910b-8b29-4fc7-bd00-51b22ca2dd68 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:42.377666 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-e4941fd6-3db4-4b9e-ada9-9151419ec65c req-13c6ea18-eab3-4dac-9093-f35940210d96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111537 Jul 12 13:42:42.382898 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 42/88] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:42.768775 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c5c78877-ceb3-4bb4-8828-ff8d763d281c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:42.769704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c5c78877-ceb3-4bb4-8828-ff8d763d281c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:42.782135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c5c78877-ceb3-4bb4-8828-ff8d763d281c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:42.782607 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c5c78877-ceb3-4bb4-8828-ff8d763d281c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:42.785051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c5c78877-ceb3-4bb4-8828-ff8d763d281c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:42.785512 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c5c78877-ceb3-4bb4-8828-ff8d763d281c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:42.968484 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f264910b-8b29-4fc7-bd00-51b22ca2dd68 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:42.977740 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f264910b-8b29-4fc7-bd00-51b22ca2dd68 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.634225 Jul 12 13:42:42.978823 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 47/89] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:42 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:42.984259 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-54530fc2-05ba-408f-be31-f6a128e496af req-ccc63575-c49a-4826-9f87-2e7079c2b0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb10a9b-adfe-4578-82cc-c87fb34cbc33", "name": "network-vif-plugged", "status": "completed", "tag": "21198481-b443-4a4b-aef1-450d509835e7"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:42.993292 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-54530fc2-05ba-408f-be31-f6a128e496af req-ccc63575-c49a-4826-9f87-2e7079c2b0db service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:42.993740 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-54530fc2-05ba-408f-be31-f6a128e496af req-ccc63575-c49a-4826-9f87-2e7079c2b0db service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:43.035777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-54530fc2-05ba-408f-be31-f6a128e496af req-ccc63575-c49a-4826-9f87-2e7079c2b0db service nova] Creating event network-vif-plugged:21198481-b443-4a4b-aef1-450d509835e7 for instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 on hv-cinder-79797 Jul 12 13:42:43.045174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-54530fc2-05ba-408f-be31-f6a128e496af req-ccc63575-c49a-4826-9f87-2e7079c2b0db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064727 Jul 12 13:42:43.049048 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 48/90] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:43.056394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-28aab7f8-bf27-4f58-b35c-24c0b04235ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:43.057302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-28aab7f8-bf27-4f58-b35c-24c0b04235ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:43.064669 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28aab7f8-bf27-4f58-b35c-24c0b04235ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:43.069678 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28aab7f8-bf27-4f58-b35c-24c0b04235ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:43.070611 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28aab7f8-bf27-4f58-b35c-24c0b04235ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:43.071057 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28aab7f8-bf27-4f58-b35c-24c0b04235ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:43.243826 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c5c78877-ceb3-4bb4-8828-ff8d763d281c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:43.266631 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c5c78877-ceb3-4bb4-8828-ff8d763d281c tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.501467 Jul 12 13:42:43.267328 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 43/91] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:42 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:43.284068 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3c422166-5a36-4fb5-b43c-6fc185b69d16 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:43.285454 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3c422166-5a36-4fb5-b43c-6fc185b69d16 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:43.300154 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c422166-5a36-4fb5-b43c-6fc185b69d16 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:43.300858 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c422166-5a36-4fb5-b43c-6fc185b69d16 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:43.302065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c422166-5a36-4fb5-b43c-6fc185b69d16 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:43.302788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c422166-5a36-4fb5-b43c-6fc185b69d16 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:43.399063 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-28aab7f8-bf27-4f58-b35c-24c0b04235ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:43.409806 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-28aab7f8-bf27-4f58-b35c-24c0b04235ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:43.412056 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-28aab7f8-bf27-4f58-b35c-24c0b04235ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:43.412554 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-28aab7f8-bf27-4f58-b35c-24c0b04235ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.361737 Jul 12 13:42:43.413119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 49/92] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:43 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:43.427785 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-48512cc3-b809-4b49-990c-060594b00bb0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:43.428449 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-48512cc3-b809-4b49-990c-060594b00bb0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:43.437184 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48512cc3-b809-4b49-990c-060594b00bb0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:43.437640 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48512cc3-b809-4b49-990c-060594b00bb0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:43.438816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48512cc3-b809-4b49-990c-060594b00bb0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:43.439480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-48512cc3-b809-4b49-990c-060594b00bb0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:43.473936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3c422166-5a36-4fb5-b43c-6fc185b69d16 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:43.482718 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3c422166-5a36-4fb5-b43c-6fc185b69d16 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.202814 Jul 12 13:42:43.483587 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 44/93] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:43 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:43.799470 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-48512cc3-b809-4b49-990c-060594b00bb0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:43.812243 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-48512cc3-b809-4b49-990c-060594b00bb0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.397890 Jul 12 13:42:43.816230 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 50/94] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:43 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:43.995913 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-011f4111-053e-48c8-9c23-895032e39b94 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:43.996843 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-011f4111-053e-48c8-9c23-895032e39b94 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:44.004272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-011f4111-053e-48c8-9c23-895032e39b94 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.005080 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-011f4111-053e-48c8-9c23-895032e39b94 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.006047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-011f4111-053e-48c8-9c23-895032e39b94 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.006596 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-011f4111-053e-48c8-9c23-895032e39b94 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.122795 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-3068f769-67eb-452f-83a2-3f786d780c0d req-fcb24a06-a786-4f4b-9d16-64a9e73e49f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dedddab8-9a74-4ae7-b88c-9320b24d5440", "tag": "321278bd-a4fa-44d4-96f0-489b7d53f4d0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:44.138320 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-3068f769-67eb-452f-83a2-3f786d780c0d req-fcb24a06-a786-4f4b-9d16-64a9e73e49f3 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.139091 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-3068f769-67eb-452f-83a2-3f786d780c0d req-fcb24a06-a786-4f4b-9d16-64a9e73e49f3 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.172632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-3068f769-67eb-452f-83a2-3f786d780c0d req-fcb24a06-a786-4f4b-9d16-64a9e73e49f3 service nova] Creating event network-changed:321278bd-a4fa-44d4-96f0-489b7d53f4d0 for instance dedddab8-9a74-4ae7-b88c-9320b24d5440 on hv-cinder-79797 Jul 12 13:42:44.179607 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-3068f769-67eb-452f-83a2-3f786d780c0d req-fcb24a06-a786-4f4b-9d16-64a9e73e49f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060978 Jul 12 13:42:44.183470 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 51/95] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:42:44.239828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-011f4111-053e-48c8-9c23-895032e39b94 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:44.250042 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-011f4111-053e-48c8-9c23-895032e39b94 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.258599 Jul 12 13:42:44.260559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 45/96] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:43 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:44.288258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d4c2816e-9522-45e5-9d03-7b3bb56160c0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:44.289234 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d4c2816e-9522-45e5-9d03-7b3bb56160c0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:44.296855 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4c2816e-9522-45e5-9d03-7b3bb56160c0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.298679 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4c2816e-9522-45e5-9d03-7b3bb56160c0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.299659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4c2816e-9522-45e5-9d03-7b3bb56160c0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.300713 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d4c2816e-9522-45e5-9d03-7b3bb56160c0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.431098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-349a0c48-4076-47a3-b6e4-98abc1d7af81 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:44.435140 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-349a0c48-4076-47a3-b6e4-98abc1d7af81 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:44.443109 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-349a0c48-4076-47a3-b6e4-98abc1d7af81 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.443558 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-349a0c48-4076-47a3-b6e4-98abc1d7af81 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.444343 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-349a0c48-4076-47a3-b6e4-98abc1d7af81 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.444795 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-349a0c48-4076-47a3-b6e4-98abc1d7af81 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.537619 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d4c2816e-9522-45e5-9d03-7b3bb56160c0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:44.550710 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d4c2816e-9522-45e5-9d03-7b3bb56160c0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.269489 Jul 12 13:42:44.551497 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 52/97] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:44 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:44.556098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-44e0706a-4987-4dd5-9fd6-35af52123a78 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:44.556931 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-44e0706a-4987-4dd5-9fd6-35af52123a78 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:44.563021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-44e0706a-4987-4dd5-9fd6-35af52123a78 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.563545 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-44e0706a-4987-4dd5-9fd6-35af52123a78 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.564388 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-44e0706a-4987-4dd5-9fd6-35af52123a78 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.564893 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-44e0706a-4987-4dd5-9fd6-35af52123a78 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.595846 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-349a0c48-4076-47a3-b6e4-98abc1d7af81 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:44.603930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-349a0c48-4076-47a3-b6e4-98abc1d7af81 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:44.605457 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-349a0c48-4076-47a3-b6e4-98abc1d7af81 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:44.606595 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-349a0c48-4076-47a3-b6e4-98abc1d7af81 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.179876 Jul 12 13:42:44.607344 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 46/98] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:44 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:44.694753 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-44e0706a-4987-4dd5-9fd6-35af52123a78 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:44.702131 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-44e0706a-4987-4dd5-9fd6-35af52123a78 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.149574 Jul 12 13:42:44.702702 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 53/99] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:44 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:44.831145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-66980f0d-815b-4e10-a650-d390b50fddb5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:44.831765 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-66980f0d-815b-4e10-a650-d390b50fddb5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:44.839237 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66980f0d-815b-4e10-a650-d390b50fddb5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.839694 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66980f0d-815b-4e10-a650-d390b50fddb5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.840467 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66980f0d-815b-4e10-a650-d390b50fddb5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:44.840911 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66980f0d-815b-4e10-a650-d390b50fddb5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:44.966990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-66980f0d-815b-4e10-a650-d390b50fddb5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:44.974519 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-66980f0d-815b-4e10-a650-d390b50fddb5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.147151 Jul 12 13:42:44.975079 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 47/100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:44 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:45.267384 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-54cf4c64-f440-4dfa-a27d-095eca8caefc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:45.267911 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-54cf4c64-f440-4dfa-a27d-095eca8caefc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:45.273938 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54cf4c64-f440-4dfa-a27d-095eca8caefc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:45.274414 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54cf4c64-f440-4dfa-a27d-095eca8caefc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:45.275171 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54cf4c64-f440-4dfa-a27d-095eca8caefc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:45.275605 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54cf4c64-f440-4dfa-a27d-095eca8caefc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:45.401490 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-54cf4c64-f440-4dfa-a27d-095eca8caefc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:45.408922 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-54cf4c64-f440-4dfa-a27d-095eca8caefc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.145407 Jul 12 13:42:45.409571 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 54/101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:45 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:45.567549 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-27f91c3f-9da9-485a-9b5c-9944e237a9ee tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:45.568110 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-27f91c3f-9da9-485a-9b5c-9944e237a9ee tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:45.574337 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-27f91c3f-9da9-485a-9b5c-9944e237a9ee tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:45.574784 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-27f91c3f-9da9-485a-9b5c-9944e237a9ee tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:45.575551 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-27f91c3f-9da9-485a-9b5c-9944e237a9ee tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:45.576002 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-27f91c3f-9da9-485a-9b5c-9944e237a9ee tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:45.630488 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ad94a959-5a59-423f-8870-1854aa3935e4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:45.631083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ad94a959-5a59-423f-8870-1854aa3935e4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:45.641479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad94a959-5a59-423f-8870-1854aa3935e4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:45.642184 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad94a959-5a59-423f-8870-1854aa3935e4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:45.643057 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad94a959-5a59-423f-8870-1854aa3935e4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:45.643630 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad94a959-5a59-423f-8870-1854aa3935e4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:45.755547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-27f91c3f-9da9-485a-9b5c-9944e237a9ee tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:45.764179 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-27f91c3f-9da9-485a-9b5c-9944e237a9ee tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.200404 Jul 12 13:42:45.764768 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 48/102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:45 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:45.770025 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c2dc061a-b775-4aaf-bbed-9550d8be68f7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:45.772141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c2dc061a-b775-4aaf-bbed-9550d8be68f7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:45.781239 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2dc061a-b775-4aaf-bbed-9550d8be68f7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:45.782309 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2dc061a-b775-4aaf-bbed-9550d8be68f7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:45.783854 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2dc061a-b775-4aaf-bbed-9550d8be68f7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:45.784829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2dc061a-b775-4aaf-bbed-9550d8be68f7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:46.033361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c2dc061a-b775-4aaf-bbed-9550d8be68f7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:46.045227 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c2dc061a-b775-4aaf-bbed-9550d8be68f7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.277651 Jul 12 13:42:46.051761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 49/103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:45 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:46.062343 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c1edbf86-eb86-4049-8082-f32059cac962 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:46.063550 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c1edbf86-eb86-4049-8082-f32059cac962 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:46.077294 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c1edbf86-eb86-4049-8082-f32059cac962 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:46.077925 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ad94a959-5a59-423f-8870-1854aa3935e4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:46.078299 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c1edbf86-eb86-4049-8082-f32059cac962 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:46.079777 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c1edbf86-eb86-4049-8082-f32059cac962 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:46.080514 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c1edbf86-eb86-4049-8082-f32059cac962 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:46.092483 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ad94a959-5a59-423f-8870-1854aa3935e4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:46.095246 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ad94a959-5a59-423f-8870-1854aa3935e4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:46.097021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ad94a959-5a59-423f-8870-1854aa3935e4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.476475 Jul 12 13:42:46.107455 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 55/104] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:45 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:46.199972 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-f9957fee-d1a8-4f44-86ed-943060408a77 req-5e17d56c-c386-4ecf-b900-a8abacf151ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71d01af-d429-48d6-9f16-6255557bdb67", "tag": "35051ab0-4751-427b-ae9e-ddc1611523c0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:46.210704 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-f9957fee-d1a8-4f44-86ed-943060408a77 req-5e17d56c-c386-4ecf-b900-a8abacf151ca service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:46.211144 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-f9957fee-d1a8-4f44-86ed-943060408a77 req-5e17d56c-c386-4ecf-b900-a8abacf151ca service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:46.226376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-f9957fee-d1a8-4f44-86ed-943060408a77 req-5e17d56c-c386-4ecf-b900-a8abacf151ca service nova] Creating event network-changed:35051ab0-4751-427b-ae9e-ddc1611523c0 for instance e71d01af-d429-48d6-9f16-6255557bdb67 on hv-cinder-79797 Jul 12 13:42:46.232754 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-f9957fee-d1a8-4f44-86ed-943060408a77 req-5e17d56c-c386-4ecf-b900-a8abacf151ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036173 Jul 12 13:42:46.239018 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 56/105] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:42:46.247331 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-a9260cd0-aeb5-429c-aed1-e6a30f530991 req-093e15d1-7df4-4293-a2a6-a0ea4aa8e1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89e1992-2407-4b9b-b805-2e68237ddc96", "name": "network-vif-plugged", "status": "completed", "tag": "4fe708d1-0106-46fa-a5fc-1441af3d9f78"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:46.257079 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a9260cd0-aeb5-429c-aed1-e6a30f530991 req-093e15d1-7df4-4293-a2a6-a0ea4aa8e1ee service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:46.257613 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-a9260cd0-aeb5-429c-aed1-e6a30f530991 req-093e15d1-7df4-4293-a2a6-a0ea4aa8e1ee service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:46.270617 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-a9260cd0-aeb5-429c-aed1-e6a30f530991 req-093e15d1-7df4-4293-a2a6-a0ea4aa8e1ee service nova] Creating event network-vif-plugged:4fe708d1-0106-46fa-a5fc-1441af3d9f78 for instance b89e1992-2407-4b9b-b805-2e68237ddc96 on hv-cinder-79797 Jul 12 13:42:46.277454 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-a9260cd0-aeb5-429c-aed1-e6a30f530991 req-093e15d1-7df4-4293-a2a6-a0ea4aa8e1ee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036640 Jul 12 13:42:46.278555 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 57/106] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:46.280512 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c1edbf86-eb86-4049-8082-f32059cac962 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:46.288536 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c1edbf86-eb86-4049-8082-f32059cac962 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1321 microversion: 2.1 time: 0.235223 Jul 12 13:42:46.289551 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 50/107] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:46 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:46.430021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-eaa80656-b953-424f-82d2-8883b9003f29 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:46.431576 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-eaa80656-b953-424f-82d2-8883b9003f29 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:46.445780 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eaa80656-b953-424f-82d2-8883b9003f29 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:46.446413 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eaa80656-b953-424f-82d2-8883b9003f29 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:46.447369 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eaa80656-b953-424f-82d2-8883b9003f29 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:46.448217 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eaa80656-b953-424f-82d2-8883b9003f29 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:46.759229 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-eaa80656-b953-424f-82d2-8883b9003f29 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:46.767335 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-eaa80656-b953-424f-82d2-8883b9003f29 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.344337 Jul 12 13:42:46.767909 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 58/108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:46 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:46.783820 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4ae888f4-a6e2-46d8-89c4-1f3f3ab7e311 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:46.784429 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4ae888f4-a6e2-46d8-89c4-1f3f3ab7e311 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:46.791212 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4ae888f4-a6e2-46d8-89c4-1f3f3ab7e311 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:46.791665 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4ae888f4-a6e2-46d8-89c4-1f3f3ab7e311 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:46.792430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4ae888f4-a6e2-46d8-89c4-1f3f3ab7e311 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:46.792872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4ae888f4-a6e2-46d8-89c4-1f3f3ab7e311 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:46.938857 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4ae888f4-a6e2-46d8-89c4-1f3f3ab7e311 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:46.946702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4ae888f4-a6e2-46d8-89c4-1f3f3ab7e311 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.168784 Jul 12 13:42:46.947473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 51/109] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:46 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:47.068120 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-64d197d1-8f15-4163-9110-1a0006650e48 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:47.068739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-64d197d1-8f15-4163-9110-1a0006650e48 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:47.075025 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d197d1-8f15-4163-9110-1a0006650e48 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.075563 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d197d1-8f15-4163-9110-1a0006650e48 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.076516 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d197d1-8f15-4163-9110-1a0006650e48 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.077064 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d197d1-8f15-4163-9110-1a0006650e48 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.116866 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7efdfe17-4076-4597-ae83-1a1c3e72efa0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:47.118002 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7efdfe17-4076-4597-ae83-1a1c3e72efa0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:47.123990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7efdfe17-4076-4597-ae83-1a1c3e72efa0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.124441 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7efdfe17-4076-4597-ae83-1a1c3e72efa0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.125259 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7efdfe17-4076-4597-ae83-1a1c3e72efa0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.125725 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7efdfe17-4076-4597-ae83-1a1c3e72efa0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.276707 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-64d197d1-8f15-4163-9110-1a0006650e48 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:47.291951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-64d197d1-8f15-4163-9110-1a0006650e48 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.227621 Jul 12 13:42:47.293430 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 59/110] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:47 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:47.307355 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b927f988-204e-4a3f-bafa-fdf6b2872e39 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:47.307976 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b927f988-204e-4a3f-bafa-fdf6b2872e39 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:47.316607 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b927f988-204e-4a3f-bafa-fdf6b2872e39 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.317054 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b927f988-204e-4a3f-bafa-fdf6b2872e39 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.318015 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b927f988-204e-4a3f-bafa-fdf6b2872e39 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.318344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b927f988-204e-4a3f-bafa-fdf6b2872e39 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.364270 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7efdfe17-4076-4597-ae83-1a1c3e72efa0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:47.374202 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7efdfe17-4076-4597-ae83-1a1c3e72efa0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:47.377107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7efdfe17-4076-4597-ae83-1a1c3e72efa0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:47.378471 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7efdfe17-4076-4597-ae83-1a1c3e72efa0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.266243 Jul 12 13:42:47.380259 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 52/111] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:47 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:42:47.550976 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b927f988-204e-4a3f-bafa-fdf6b2872e39 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:47.558896 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b927f988-204e-4a3f-bafa-fdf6b2872e39 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1515 microversion: 2.1 time: 0.255773 Jul 12 13:42:47.559583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 60/112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:47 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:47.579709 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-357c7f5a-baa0-495a-8c3f-bd8b59b3c42c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:47.580871 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-357c7f5a-baa0-495a-8c3f-bd8b59b3c42c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:47.588448 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-357c7f5a-baa0-495a-8c3f-bd8b59b3c42c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.589031 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-357c7f5a-baa0-495a-8c3f-bd8b59b3c42c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.589780 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-357c7f5a-baa0-495a-8c3f-bd8b59b3c42c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.590255 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-357c7f5a-baa0-495a-8c3f-bd8b59b3c42c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.652394 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-357c7f5a-baa0-495a-8c3f-bd8b59b3c42c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lazy-loading 'flavor' on Instance uuid 1cd43000-7184-403f-b685-55b46308109a {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:42:47.803244 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-357c7f5a-baa0-495a-8c3f-bd8b59b3c42c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a/action" status: 200 len: 32 microversion: 2.1 time: 0.229224 Jul 12 13:42:47.804383 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3c2154d5-9752-4223-9112-ccb91830e94a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:47.804788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 53/113] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:42:47 2022] POST /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:42:47.806145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3c2154d5-9752-4223-9112-ccb91830e94a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:47.816481 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-99c31e3b-3f54-4e23-9bcf-c4ebf8102890 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:47.817448 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-99c31e3b-3f54-4e23-9bcf-c4ebf8102890 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:47.829784 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-99c31e3b-3f54-4e23-9bcf-c4ebf8102890 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.830498 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-99c31e3b-3f54-4e23-9bcf-c4ebf8102890 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.832214 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-99c31e3b-3f54-4e23-9bcf-c4ebf8102890 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.832946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-99c31e3b-3f54-4e23-9bcf-c4ebf8102890 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.834489 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3c2154d5-9752-4223-9112-ccb91830e94a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.835367 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3c2154d5-9752-4223-9112-ccb91830e94a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:47.836817 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3c2154d5-9752-4223-9112-ccb91830e94a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:47.838520 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3c2154d5-9752-4223-9112-ccb91830e94a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:48.137820 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3c2154d5-9752-4223-9112-ccb91830e94a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:48.147746 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3c2154d5-9752-4223-9112-ccb91830e94a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.366762 Jul 12 13:42:48.148390 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 61/114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:47 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:48.155329 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d1ab7abe-890b-418f-9143-337ec1487f6d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:48.156156 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d1ab7abe-890b-418f-9143-337ec1487f6d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:48.164025 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1ab7abe-890b-418f-9143-337ec1487f6d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:48.164852 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1ab7abe-890b-418f-9143-337ec1487f6d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:48.166083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1ab7abe-890b-418f-9143-337ec1487f6d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:48.168041 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1ab7abe-890b-418f-9143-337ec1487f6d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:48.285163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-99c31e3b-3f54-4e23-9bcf-c4ebf8102890 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:48.293234 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-99c31e3b-3f54-4e23-9bcf-c4ebf8102890 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.481108 Jul 12 13:42:48.293817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 54/115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:47 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:48.308993 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7ffe786c-7f54-4758-8034-95e54ce1a081 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:48.309617 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7ffe786c-7f54-4758-8034-95e54ce1a081 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:48.310279 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d1ab7abe-890b-418f-9143-337ec1487f6d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:48.316047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7ffe786c-7f54-4758-8034-95e54ce1a081 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:48.316502 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7ffe786c-7f54-4758-8034-95e54ce1a081 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:48.317278 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7ffe786c-7f54-4758-8034-95e54ce1a081 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:48.317717 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7ffe786c-7f54-4758-8034-95e54ce1a081 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:48.320041 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d1ab7abe-890b-418f-9143-337ec1487f6d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.168961 Jul 12 13:42:48.320832 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 62/116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:48 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:48.403198 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9d19fbbf-c8ac-48c3-a4e0-a103b09b676b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:48.403885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9d19fbbf-c8ac-48c3-a4e0-a103b09b676b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:48.410759 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d19fbbf-c8ac-48c3-a4e0-a103b09b676b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:48.411121 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d19fbbf-c8ac-48c3-a4e0-a103b09b676b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:48.412141 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d19fbbf-c8ac-48c3-a4e0-a103b09b676b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:48.412582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d19fbbf-c8ac-48c3-a4e0-a103b09b676b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:48.451530 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7ffe786c-7f54-4758-8034-95e54ce1a081 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:48.459997 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7ffe786c-7f54-4758-8034-95e54ce1a081 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.155209 Jul 12 13:42:48.460579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 55/117] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:48 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:48.547940 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9d19fbbf-c8ac-48c3-a4e0-a103b09b676b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:48.556021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9d19fbbf-c8ac-48c3-a4e0-a103b09b676b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:48.557549 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9d19fbbf-c8ac-48c3-a4e0-a103b09b676b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:48.558689 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9d19fbbf-c8ac-48c3-a4e0-a103b09b676b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.165684 Jul 12 13:42:48.559253 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 63/118] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:48 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:42:49.165286 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5d47e0fe-b9f6-4715-b189-2270bf0a58aa tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:49.165926 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5d47e0fe-b9f6-4715-b189-2270bf0a58aa tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:49.171933 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5d47e0fe-b9f6-4715-b189-2270bf0a58aa tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:49.172390 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5d47e0fe-b9f6-4715-b189-2270bf0a58aa tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:49.173165 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5d47e0fe-b9f6-4715-b189-2270bf0a58aa tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:49.173608 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5d47e0fe-b9f6-4715-b189-2270bf0a58aa tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:49.310385 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b850a8cf-e9f7-4823-9521-64cc5fe53a5f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:49.311762 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b850a8cf-e9f7-4823-9521-64cc5fe53a5f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:49.318564 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b850a8cf-e9f7-4823-9521-64cc5fe53a5f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:49.319200 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b850a8cf-e9f7-4823-9521-64cc5fe53a5f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:49.320142 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b850a8cf-e9f7-4823-9521-64cc5fe53a5f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:49.320746 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b850a8cf-e9f7-4823-9521-64cc5fe53a5f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:49.321241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5d47e0fe-b9f6-4715-b189-2270bf0a58aa tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:49.323583 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:49.336094 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5d47e0fe-b9f6-4715-b189-2270bf0a58aa tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.175547 Jul 12 13:42:49.337052 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 56/119] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:49 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:49.348282 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d9606ccb-2460-4f37-84b9-2042c0b8cf28 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:49.351172 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d9606ccb-2460-4f37-84b9-2042c0b8cf28 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:49.356066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:49.359823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d9606ccb-2460-4f37-84b9-2042c0b8cf28 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:49.360474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d9606ccb-2460-4f37-84b9-2042c0b8cf28 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:49.361268 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d9606ccb-2460-4f37-84b9-2042c0b8cf28 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:49.361708 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d9606ccb-2460-4f37-84b9-2042c0b8cf28 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:49.542441 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b850a8cf-e9f7-4823-9521-64cc5fe53a5f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:49.545648 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d9606ccb-2460-4f37-84b9-2042c0b8cf28 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:49.551228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b850a8cf-e9f7-4823-9521-64cc5fe53a5f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.244817 Jul 12 13:42:49.552191 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 64/120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:49 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:49.563217 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d9606ccb-2460-4f37-84b9-2042c0b8cf28 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.224921 Jul 12 13:42:49.564062 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 57/121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:49 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:49.572962 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-59536f43-b0a2-4cfa-bf84-3605b92f525e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:49.572962 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-59536f43-b0a2-4cfa-bf84-3605b92f525e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:49.573457 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-59536f43-b0a2-4cfa-bf84-3605b92f525e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:49.573924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-59536f43-b0a2-4cfa-bf84-3605b92f525e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:49.574793 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-59536f43-b0a2-4cfa-bf84-3605b92f525e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:49.575326 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-59536f43-b0a2-4cfa-bf84-3605b92f525e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:49.581155 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-fd54cb36-a30f-40e5-8295-32a01ef10240 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:49.582582 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-fd54cb36-a30f-40e5-8295-32a01ef10240 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:49.591154 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fd54cb36-a30f-40e5-8295-32a01ef10240 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:49.591918 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fd54cb36-a30f-40e5-8295-32a01ef10240 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:49.592870 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fd54cb36-a30f-40e5-8295-32a01ef10240 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:49.593530 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fd54cb36-a30f-40e5-8295-32a01ef10240 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:49.829822 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-59536f43-b0a2-4cfa-bf84-3605b92f525e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:49.839197 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-59536f43-b0a2-4cfa-bf84-3605b92f525e tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.286006 Jul 12 13:42:49.840000 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 65/122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:49 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:49.912316 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-fd54cb36-a30f-40e5-8295-32a01ef10240 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:49.920704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-fd54cb36-a30f-40e5-8295-32a01ef10240 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:49.922258 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-fd54cb36-a30f-40e5-8295-32a01ef10240 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:49.923393 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-fd54cb36-a30f-40e5-8295-32a01ef10240 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.348576 Jul 12 13:42:49.934344 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 58/123] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:49 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:50.359936 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d165619a-9916-4cc1-b109-e262253288a6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:50.362429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d165619a-9916-4cc1-b109-e262253288a6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:50.372511 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d165619a-9916-4cc1-b109-e262253288a6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:50.373050 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d165619a-9916-4cc1-b109-e262253288a6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:50.373916 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d165619a-9916-4cc1-b109-e262253288a6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:50.374594 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d165619a-9916-4cc1-b109-e262253288a6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:50.567401 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-80c371db-99ba-4745-909d-a3c4e6fa9785 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:50.568116 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-80c371db-99ba-4745-909d-a3c4e6fa9785 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:50.577515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d165619a-9916-4cc1-b109-e262253288a6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:50.579011 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-80c371db-99ba-4745-909d-a3c4e6fa9785 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:50.579468 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-80c371db-99ba-4745-909d-a3c4e6fa9785 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:50.580259 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-80c371db-99ba-4745-909d-a3c4e6fa9785 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:50.580702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-80c371db-99ba-4745-909d-a3c4e6fa9785 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:50.593423 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d165619a-9916-4cc1-b109-e262253288a6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.243395 Jul 12 13:42:50.595231 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 66/124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:50 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:50.601575 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3895d1cc-e7ba-4f03-a19e-04f11be45ead tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:50.602496 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3895d1cc-e7ba-4f03-a19e-04f11be45ead tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:50.622669 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3895d1cc-e7ba-4f03-a19e-04f11be45ead tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:50.624170 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3895d1cc-e7ba-4f03-a19e-04f11be45ead tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:50.625268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3895d1cc-e7ba-4f03-a19e-04f11be45ead tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:50.625908 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3895d1cc-e7ba-4f03-a19e-04f11be45ead tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:50.798683 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3895d1cc-e7ba-4f03-a19e-04f11be45ead tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:50.807203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3895d1cc-e7ba-4f03-a19e-04f11be45ead tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1313 microversion: 2.1 time: 0.209643 Jul 12 13:42:50.808001 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 67/125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:50 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:50.809875 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-80c371db-99ba-4745-909d-a3c4e6fa9785 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:50.818469 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-80c371db-99ba-4745-909d-a3c4e6fa9785 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.254827 Jul 12 13:42:50.819351 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 59/126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:50 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:50.857559 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9f242ae9-a1d6-4fd3-9148-3c98739b13ad tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:50.858520 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9f242ae9-a1d6-4fd3-9148-3c98739b13ad tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:50.866467 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f242ae9-a1d6-4fd3-9148-3c98739b13ad tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:50.866797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f242ae9-a1d6-4fd3-9148-3c98739b13ad tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:50.867679 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f242ae9-a1d6-4fd3-9148-3c98739b13ad tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:50.868283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9f242ae9-a1d6-4fd3-9148-3c98739b13ad tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:50.940857 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b1585f03-5909-4305-9e90-0bd75ccadc91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:50.941472 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b1585f03-5909-4305-9e90-0bd75ccadc91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:50.947940 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1585f03-5909-4305-9e90-0bd75ccadc91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:50.948621 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1585f03-5909-4305-9e90-0bd75ccadc91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:50.949591 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1585f03-5909-4305-9e90-0bd75ccadc91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:50.950346 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1585f03-5909-4305-9e90-0bd75ccadc91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:51.022757 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9f242ae9-a1d6-4fd3-9148-3c98739b13ad tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:51.030565 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9f242ae9-a1d6-4fd3-9148-3c98739b13ad tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.177643 Jul 12 13:42:51.031144 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 68/127] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:50 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:51.126206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b1585f03-5909-4305-9e90-0bd75ccadc91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:51.135989 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b1585f03-5909-4305-9e90-0bd75ccadc91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:51.137521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b1585f03-5909-4305-9e90-0bd75ccadc91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:51.138680 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b1585f03-5909-4305-9e90-0bd75ccadc91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.201760 Jul 12 13:42:51.139240 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 60/128] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:50 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:51.616713 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-62791f16-14f3-4ac2-bcc5-201c24abc13a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:51.617645 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-62791f16-14f3-4ac2-bcc5-201c24abc13a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:51.624312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-62791f16-14f3-4ac2-bcc5-201c24abc13a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:51.624768 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-62791f16-14f3-4ac2-bcc5-201c24abc13a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:51.625634 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-62791f16-14f3-4ac2-bcc5-201c24abc13a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:51.626041 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-62791f16-14f3-4ac2-bcc5-201c24abc13a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:51.769259 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-62791f16-14f3-4ac2-bcc5-201c24abc13a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:51.779345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-62791f16-14f3-4ac2-bcc5-201c24abc13a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.170096 Jul 12 13:42:51.779926 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 69/129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:51 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:51.825605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1adabeff-e7fe-4d14-a1ca-ebfe09148ff0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:51.826324 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1adabeff-e7fe-4d14-a1ca-ebfe09148ff0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:51.834807 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1adabeff-e7fe-4d14-a1ca-ebfe09148ff0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:51.835265 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1adabeff-e7fe-4d14-a1ca-ebfe09148ff0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:51.836038 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1adabeff-e7fe-4d14-a1ca-ebfe09148ff0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:51.836480 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1adabeff-e7fe-4d14-a1ca-ebfe09148ff0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:51.838514 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-21d8b460-a7c0-4b8f-9ee8-a6a9edd80ecf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:51.839126 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-21d8b460-a7c0-4b8f-9ee8-a6a9edd80ecf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:51.859225 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21d8b460-a7c0-4b8f-9ee8-a6a9edd80ecf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:51.859823 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21d8b460-a7c0-4b8f-9ee8-a6a9edd80ecf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:51.860671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21d8b460-a7c0-4b8f-9ee8-a6a9edd80ecf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:51.861116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21d8b460-a7c0-4b8f-9ee8-a6a9edd80ecf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:52.054694 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1adabeff-e7fe-4d14-a1ca-ebfe09148ff0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:52.065527 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1adabeff-e7fe-4d14-a1ca-ebfe09148ff0 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1500 microversion: 2.1 time: 0.245013 Jul 12 13:42:52.066696 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 61/130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:51 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1500 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:52.072074 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1c01ab00-a5b5-4ea9-a829-6816e46edc86 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:52.072677 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1c01ab00-a5b5-4ea9-a829-6816e46edc86 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:52.079150 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1c01ab00-a5b5-4ea9-a829-6816e46edc86 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:52.079600 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1c01ab00-a5b5-4ea9-a829-6816e46edc86 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:52.080361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1c01ab00-a5b5-4ea9-a829-6816e46edc86 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:52.080799 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1c01ab00-a5b5-4ea9-a829-6816e46edc86 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:52.338211 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1c01ab00-a5b5-4ea9-a829-6816e46edc86 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:52.352302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1c01ab00-a5b5-4ea9-a829-6816e46edc86 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.282195 Jul 12 13:42:52.353160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 62/131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:52 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:52.364962 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6be84454-3502-49c8-9112-0431db7ba7c6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:52.371005 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6be84454-3502-49c8-9112-0431db7ba7c6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:52.379021 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:52.387675 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6be84454-3502-49c8-9112-0431db7ba7c6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:52.390901 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6be84454-3502-49c8-9112-0431db7ba7c6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:52.393909 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6be84454-3502-49c8-9112-0431db7ba7c6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:52.394567 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6be84454-3502-49c8-9112-0431db7ba7c6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:52.419504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-21d8b460-a7c0-4b8f-9ee8-a6a9edd80ecf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:52.439582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-21d8b460-a7c0-4b8f-9ee8-a6a9edd80ecf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.607206 Jul 12 13:42:52.441618 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 70/132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:51 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:52.617034 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6be84454-3502-49c8-9112-0431db7ba7c6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:52.632107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6be84454-3502-49c8-9112-0431db7ba7c6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:52.638199 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6be84454-3502-49c8-9112-0431db7ba7c6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:52.642384 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6be84454-3502-49c8-9112-0431db7ba7c6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.285239 Jul 12 13:42:52.644976 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 63/133] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:52 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:52.744885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-6a36792f-14c9-486e-a43f-9faec458aa7e req-5262d437-e7b1-41c6-8757-300cad0ecb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b0cff6-7efa-4a5b-bcfa-e9e435a77da9", "name": "network-vif-plugged", "status": "completed", "tag": "4596e2d0-f0f2-49b9-a0a8-ab69ee88ab56"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:52.761822 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-6a36792f-14c9-486e-a43f-9faec458aa7e req-5262d437-e7b1-41c6-8757-300cad0ecb61 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:52.762556 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-6a36792f-14c9-486e-a43f-9faec458aa7e req-5262d437-e7b1-41c6-8757-300cad0ecb61 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:52.794782 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-6a36792f-14c9-486e-a43f-9faec458aa7e req-5262d437-e7b1-41c6-8757-300cad0ecb61 service nova] Creating event network-vif-plugged:4596e2d0-f0f2-49b9-a0a8-ab69ee88ab56 for instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 on hv-cinder-79797 Jul 12 13:42:52.798739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8790540e-96b9-412e-a2f9-3cbf367896c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:52.799695 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8790540e-96b9-412e-a2f9-3cbf367896c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:52.816228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-6a36792f-14c9-486e-a43f-9faec458aa7e req-5262d437-e7b1-41c6-8757-300cad0ecb61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061994 Jul 12 13:42:52.818486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 71/134] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:52.820881 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8790540e-96b9-412e-a2f9-3cbf367896c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:52.822498 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8790540e-96b9-412e-a2f9-3cbf367896c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:52.824906 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8790540e-96b9-412e-a2f9-3cbf367896c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:52.831441 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8790540e-96b9-412e-a2f9-3cbf367896c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:53.078574 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8790540e-96b9-412e-a2f9-3cbf367896c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:53.089944 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8790540e-96b9-412e-a2f9-3cbf367896c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.295711 Jul 12 13:42:53.095042 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 64/135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:52 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:53.370132 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-669f21a0-bc31-456d-8061-c82683888dbb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:53.370879 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-669f21a0-bc31-456d-8061-c82683888dbb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:53.377845 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-669f21a0-bc31-456d-8061-c82683888dbb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:53.378486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-669f21a0-bc31-456d-8061-c82683888dbb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:53.379273 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-669f21a0-bc31-456d-8061-c82683888dbb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:53.379857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-669f21a0-bc31-456d-8061-c82683888dbb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:53.459205 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f56659f8-2736-486e-86ff-9ceff9cb2734 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:53.466835 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f56659f8-2736-486e-86ff-9ceff9cb2734 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:53.477264 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f56659f8-2736-486e-86ff-9ceff9cb2734 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:53.478215 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f56659f8-2736-486e-86ff-9ceff9cb2734 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:53.479227 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f56659f8-2736-486e-86ff-9ceff9cb2734 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:53.479883 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f56659f8-2736-486e-86ff-9ceff9cb2734 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:53.565281 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-669f21a0-bc31-456d-8061-c82683888dbb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:53.575360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-669f21a0-bc31-456d-8061-c82683888dbb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.210316 Jul 12 13:42:53.576769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 72/136] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:53 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:53.662689 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1dc004b2-643f-441e-972e-697e963693d3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:53.663461 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1dc004b2-643f-441e-972e-697e963693d3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:53.670778 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1dc004b2-643f-441e-972e-697e963693d3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:53.671624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1dc004b2-643f-441e-972e-697e963693d3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:53.672614 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1dc004b2-643f-441e-972e-697e963693d3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:53.673282 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1dc004b2-643f-441e-972e-697e963693d3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:53.691656 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f56659f8-2736-486e-86ff-9ceff9cb2734 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:53.705911 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f56659f8-2736-486e-86ff-9ceff9cb2734 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.248406 Jul 12 13:42:53.719664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 65/137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:53 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:53.775854 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d0df8fef-c1ef-4bb2-805a-b21048316545 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98c73bc6-18b1-411c-b35c-edcee0234988"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:53.776989 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d0df8fef-c1ef-4bb2-805a-b21048316545 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:53.790238 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0df8fef-c1ef-4bb2-805a-b21048316545 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:53.794591 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0df8fef-c1ef-4bb2-805a-b21048316545 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:53.795477 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0df8fef-c1ef-4bb2-805a-b21048316545 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:53.795918 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0df8fef-c1ef-4bb2-805a-b21048316545 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:53.893948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1dc004b2-643f-441e-972e-697e963693d3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:53.909114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1dc004b2-643f-441e-972e-697e963693d3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:53.914633 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1dc004b2-643f-441e-972e-697e963693d3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:53.915783 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1dc004b2-643f-441e-972e-697e963693d3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.257736 Jul 12 13:42:53.916799 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 73/138] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:53 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:42:54.111220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5122d051-057e-4428-b98d-358a7d0efb81 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:54.111971 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5122d051-057e-4428-b98d-358a7d0efb81 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:54.118780 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5122d051-057e-4428-b98d-358a7d0efb81 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:54.119237 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5122d051-057e-4428-b98d-358a7d0efb81 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:54.120013 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5122d051-057e-4428-b98d-358a7d0efb81 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:54.120458 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5122d051-057e-4428-b98d-358a7d0efb81 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:54.312219 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5122d051-057e-4428-b98d-358a7d0efb81 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:54.319895 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5122d051-057e-4428-b98d-358a7d0efb81 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1361 microversion: 2.1 time: 0.212499 Jul 12 13:42:54.329599 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 74/139] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:54 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:42:54.344437 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d0df8fef-c1ef-4bb2-805a-b21048316545 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "POST /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.573384 Jul 12 13:42:54.345242 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 66/140] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:42:53 2022] POST /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:54.594381 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-214c0608-5250-44e8-927f-d98cd6c480d0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:54.595004 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-214c0608-5250-44e8-927f-d98cd6c480d0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:54.601672 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-214c0608-5250-44e8-927f-d98cd6c480d0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:54.602149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-214c0608-5250-44e8-927f-d98cd6c480d0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:54.602904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-214c0608-5250-44e8-927f-d98cd6c480d0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:54.603371 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-214c0608-5250-44e8-927f-d98cd6c480d0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:54.727800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-92551b7d-fb02-4f31-9b92-6865f66b6349 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:54.728505 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-92551b7d-fb02-4f31-9b92-6865f66b6349 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:54.734715 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-92551b7d-fb02-4f31-9b92-6865f66b6349 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:54.735167 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-92551b7d-fb02-4f31-9b92-6865f66b6349 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:54.735932 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-92551b7d-fb02-4f31-9b92-6865f66b6349 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:54.736574 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-92551b7d-fb02-4f31-9b92-6865f66b6349 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:54.759551 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-214c0608-5250-44e8-927f-d98cd6c480d0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:54.767213 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-214c0608-5250-44e8-927f-d98cd6c480d0 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.176550 Jul 12 13:42:54.767847 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 75/141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:54 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:54.894285 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-92551b7d-fb02-4f31-9b92-6865f66b6349 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:54.918453 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-92551b7d-fb02-4f31-9b92-6865f66b6349 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.182345 Jul 12 13:42:54.934033 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 67/142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:54 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:54.934424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-83b26bfd-9cbf-4570-b792-a7c1a990f1e3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:54.935137 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-83b26bfd-9cbf-4570-b792-a7c1a990f1e3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:54.940043 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:54.952475 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83b26bfd-9cbf-4570-b792-a7c1a990f1e3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:54.954565 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83b26bfd-9cbf-4570-b792-a7c1a990f1e3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:54.955782 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83b26bfd-9cbf-4570-b792-a7c1a990f1e3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:54.957119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83b26bfd-9cbf-4570-b792-a7c1a990f1e3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:55.149474 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-83b26bfd-9cbf-4570-b792-a7c1a990f1e3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:55.158482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-83b26bfd-9cbf-4570-b792-a7c1a990f1e3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:55.160251 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-83b26bfd-9cbf-4570-b792-a7c1a990f1e3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:55.161688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-83b26bfd-9cbf-4570-b792-a7c1a990f1e3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.231857 Jul 12 13:42:55.165589 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 76/143] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:54 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:55.338902 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-02859a86-281f-4f2f-abad-d1df5b10f7fd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:55.340144 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-02859a86-281f-4f2f-abad-d1df5b10f7fd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:55.348465 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02859a86-281f-4f2f-abad-d1df5b10f7fd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:55.349593 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02859a86-281f-4f2f-abad-d1df5b10f7fd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:55.350562 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02859a86-281f-4f2f-abad-d1df5b10f7fd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:55.351393 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02859a86-281f-4f2f-abad-d1df5b10f7fd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:55.490296 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-02859a86-281f-4f2f-abad-d1df5b10f7fd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:55.498326 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-02859a86-281f-4f2f-abad-d1df5b10f7fd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1547 microversion: 2.1 time: 0.165304 Jul 12 13:42:55.499202 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 68/144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:55 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:55.516457 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8212f1ba-d7ee-4501-9c06-a91ef523c168 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:55.516950 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8212f1ba-d7ee-4501-9c06-a91ef523c168 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:55.523757 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8212f1ba-d7ee-4501-9c06-a91ef523c168 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:55.524296 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8212f1ba-d7ee-4501-9c06-a91ef523c168 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:55.525152 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8212f1ba-d7ee-4501-9c06-a91ef523c168 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:55.525663 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8212f1ba-d7ee-4501-9c06-a91ef523c168 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:55.679667 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8212f1ba-d7ee-4501-9c06-a91ef523c168 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167141 Jul 12 13:42:55.680337 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 77/145] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jul 12 13:42:55 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:55.785467 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-150f77e1-5c59-4fa6-8dd2-d74d2cc44915 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:55.786200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-150f77e1-5c59-4fa6-8dd2-d74d2cc44915 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:55.793175 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-150f77e1-5c59-4fa6-8dd2-d74d2cc44915 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:55.794002 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-150f77e1-5c59-4fa6-8dd2-d74d2cc44915 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:55.794977 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-150f77e1-5c59-4fa6-8dd2-d74d2cc44915 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:55.795486 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-150f77e1-5c59-4fa6-8dd2-d74d2cc44915 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:55.948856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3b12a0c5-9526-43c1-84e0-17f45e2c84e1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:55.952316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3b12a0c5-9526-43c1-84e0-17f45e2c84e1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:55.964501 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b12a0c5-9526-43c1-84e0-17f45e2c84e1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:55.965202 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b12a0c5-9526-43c1-84e0-17f45e2c84e1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:55.967015 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b12a0c5-9526-43c1-84e0-17f45e2c84e1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:55.968310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3b12a0c5-9526-43c1-84e0-17f45e2c84e1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:55.989119 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-150f77e1-5c59-4fa6-8dd2-d74d2cc44915 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:56.001221 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-150f77e1-5c59-4fa6-8dd2-d74d2cc44915 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.220347 Jul 12 13:42:56.002676 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 69/146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:55 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:56.185914 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-776ee33f-f77c-4352-a824-55b56fb36664 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:56.186563 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-776ee33f-f77c-4352-a824-55b56fb36664 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:56.195147 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-776ee33f-f77c-4352-a824-55b56fb36664 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:56.196098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-776ee33f-f77c-4352-a824-55b56fb36664 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:56.197650 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-776ee33f-f77c-4352-a824-55b56fb36664 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:56.198417 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-776ee33f-f77c-4352-a824-55b56fb36664 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:56.378451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-776ee33f-f77c-4352-a824-55b56fb36664 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:56.387203 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-776ee33f-f77c-4352-a824-55b56fb36664 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:56.389447 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-776ee33f-f77c-4352-a824-55b56fb36664 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:56.390765 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-776ee33f-f77c-4352-a824-55b56fb36664 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.210404 Jul 12 13:42:56.391552 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 70/147] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:56 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:56.420305 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-94ff1479-c2c2-493a-81e5-9aff20886a7c req-fec1bc52-8e04-4000-858b-32c34a527a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d01af-d429-48d6-9f16-6255557bdb67", "name": "network-vif-plugged", "status": "completed", "tag": "35051ab0-4751-427b-ae9e-ddc1611523c0"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:56.451120 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-94ff1479-c2c2-493a-81e5-9aff20886a7c req-fec1bc52-8e04-4000-858b-32c34a527a55 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:56.451713 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-94ff1479-c2c2-493a-81e5-9aff20886a7c req-fec1bc52-8e04-4000-858b-32c34a527a55 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:56.469430 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3b12a0c5-9526-43c1-84e0-17f45e2c84e1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:56.481380 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3b12a0c5-9526-43c1-84e0-17f45e2c84e1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.540800 Jul 12 13:42:56.492261 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-94ff1479-c2c2-493a-81e5-9aff20886a7c req-fec1bc52-8e04-4000-858b-32c34a527a55 service nova] Creating event network-vif-plugged:35051ab0-4751-427b-ae9e-ddc1611523c0 for instance e71d01af-d429-48d6-9f16-6255557bdb67 on hv-cinder-79797 Jul 12 13:42:56.496635 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 78/148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:55 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:56.505839 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-94ff1479-c2c2-493a-81e5-9aff20886a7c req-fec1bc52-8e04-4000-858b-32c34a527a55 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100363 Jul 12 13:42:56.509133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 71/149] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:57.017886 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aa9c767f-a05d-4464-9d33-3550145378b4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:57.019168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aa9c767f-a05d-4464-9d33-3550145378b4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:57.025905 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa9c767f-a05d-4464-9d33-3550145378b4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:57.026610 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa9c767f-a05d-4464-9d33-3550145378b4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:57.027437 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa9c767f-a05d-4464-9d33-3550145378b4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:57.028188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa9c767f-a05d-4464-9d33-3550145378b4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:57.410748 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f5c0aea5-4aa5-41e8-b6b1-42914902d83e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:57.412502 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f5c0aea5-4aa5-41e8-b6b1-42914902d83e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:57.418745 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5c0aea5-4aa5-41e8-b6b1-42914902d83e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:57.419565 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5c0aea5-4aa5-41e8-b6b1-42914902d83e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:57.420964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5c0aea5-4aa5-41e8-b6b1-42914902d83e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:57.421538 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5c0aea5-4aa5-41e8-b6b1-42914902d83e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:57.530306 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa9c767f-a05d-4464-9d33-3550145378b4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:57.541565 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aa9c767f-a05d-4464-9d33-3550145378b4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.527497 Jul 12 13:42:57.542860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 79/150] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:57 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:57.548107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-42ea3fe9-cf00-412c-af01-a52c36fa962e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:57.548899 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-42ea3fe9-cf00-412c-af01-a52c36fa962e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:57.555736 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-42ea3fe9-cf00-412c-af01-a52c36fa962e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:57.556689 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-42ea3fe9-cf00-412c-af01-a52c36fa962e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:57.557699 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-42ea3fe9-cf00-412c-af01-a52c36fa962e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:57.558315 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-42ea3fe9-cf00-412c-af01-a52c36fa962e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:57.609923 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f5c0aea5-4aa5-41e8-b6b1-42914902d83e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:57.612365 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:57.622869 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f5c0aea5-4aa5-41e8-b6b1-42914902d83e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:57.624906 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f5c0aea5-4aa5-41e8-b6b1-42914902d83e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:57.626797 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f5c0aea5-4aa5-41e8-b6b1-42914902d83e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.221650 Jul 12 13:42:57.627756 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 72/151] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:57 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:42:57.765561 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-42ea3fe9-cf00-412c-af01-a52c36fa962e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:57.777641 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-42ea3fe9-cf00-412c-af01-a52c36fa962e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.233537 Jul 12 13:42:57.778348 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 80/152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:57 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:57.910944 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-bc792206-183d-4c71-a203-42193d9f8e6c req-1e44ec77-fef7-4fb6-9f37-7f6ba97774a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56b0cff6-7efa-4a5b-bcfa-e9e435a77da9", "tag": "4596e2d0-f0f2-49b9-a0a8-ab69ee88ab56"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:57.922988 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-bc792206-183d-4c71-a203-42193d9f8e6c req-1e44ec77-fef7-4fb6-9f37-7f6ba97774a5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:57.924452 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-bc792206-183d-4c71-a203-42193d9f8e6c req-1e44ec77-fef7-4fb6-9f37-7f6ba97774a5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:57.937928 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-bc792206-183d-4c71-a203-42193d9f8e6c req-1e44ec77-fef7-4fb6-9f37-7f6ba97774a5 service nova] Creating event network-changed:4596e2d0-f0f2-49b9-a0a8-ab69ee88ab56 for instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 on hv-cinder-79797 Jul 12 13:42:57.943166 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-bc792206-183d-4c71-a203-42193d9f8e6c req-1e44ec77-fef7-4fb6-9f37-7f6ba97774a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035942 Jul 12 13:42:57.943964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 73/153] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:42:58.533139 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-5a32be9f-e0f9-48d8-936c-59e41a2da02b req-24d3ca5b-fa2d-4db0-8dfc-cde57a6864bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedddab8-9a74-4ae7-b88c-9320b24d5440", "name": "network-vif-plugged", "status": "completed", "tag": "321278bd-a4fa-44d4-96f0-489b7d53f4d0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:42:58.550993 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-5a32be9f-e0f9-48d8-936c-59e41a2da02b req-24d3ca5b-fa2d-4db0-8dfc-cde57a6864bb service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:58.551622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-5a32be9f-e0f9-48d8-936c-59e41a2da02b req-24d3ca5b-fa2d-4db0-8dfc-cde57a6864bb service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:58.559419 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-72f67fd9-bb6f-497f-ab63-7e67927e04f5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:58.560132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-72f67fd9-bb6f-497f-ab63-7e67927e04f5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:58.570732 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72f67fd9-bb6f-497f-ab63-7e67927e04f5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:58.571191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72f67fd9-bb6f-497f-ab63-7e67927e04f5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:58.571970 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72f67fd9-bb6f-497f-ab63-7e67927e04f5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:58.572413 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72f67fd9-bb6f-497f-ab63-7e67927e04f5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:58.586228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-5a32be9f-e0f9-48d8-936c-59e41a2da02b req-24d3ca5b-fa2d-4db0-8dfc-cde57a6864bb service nova] Creating event network-vif-plugged:321278bd-a4fa-44d4-96f0-489b7d53f4d0 for instance dedddab8-9a74-4ae7-b88c-9320b24d5440 on hv-cinder-79797 Jul 12 13:42:58.592148 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-5a32be9f-e0f9-48d8-936c-59e41a2da02b req-24d3ca5b-fa2d-4db0-8dfc-cde57a6864bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062651 Jul 12 13:42:58.593726 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 81/154] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:42:58.646785 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-dccd7378-c9e7-41a2-a574-7e24c8f8df5c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:58.647474 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-dccd7378-c9e7-41a2-a574-7e24c8f8df5c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:58.658771 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dccd7378-c9e7-41a2-a574-7e24c8f8df5c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:58.660163 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dccd7378-c9e7-41a2-a574-7e24c8f8df5c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:58.661727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dccd7378-c9e7-41a2-a574-7e24c8f8df5c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:58.662429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dccd7378-c9e7-41a2-a574-7e24c8f8df5c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:58.792107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-72f67fd9-bb6f-497f-ab63-7e67927e04f5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:58.803538 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-72f67fd9-bb6f-497f-ab63-7e67927e04f5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.248470 Jul 12 13:42:58.804642 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 74/155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:58 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:58.811029 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-388993fe-91af-480f-a4ef-269f611ba748 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:58.811867 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-388993fe-91af-480f-a4ef-269f611ba748 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:58.819568 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-388993fe-91af-480f-a4ef-269f611ba748 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:58.820277 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-388993fe-91af-480f-a4ef-269f611ba748 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:58.821819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-388993fe-91af-480f-a4ef-269f611ba748 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:58.822504 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-388993fe-91af-480f-a4ef-269f611ba748 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:58.888023 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-dccd7378-c9e7-41a2-a574-7e24c8f8df5c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:58.894274 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:58.902074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-dccd7378-c9e7-41a2-a574-7e24c8f8df5c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:58.906413 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-dccd7378-c9e7-41a2-a574-7e24c8f8df5c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:58.908265 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-dccd7378-c9e7-41a2-a574-7e24c8f8df5c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.266822 Jul 12 13:42:58.908929 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 82/156] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:58 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:42:59.020159 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-388993fe-91af-480f-a4ef-269f611ba748 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:42:59.028535 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-388993fe-91af-480f-a4ef-269f611ba748 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.222319 Jul 12 13:42:59.035794 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 75/157] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:58 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:42:59.821379 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c0eefad6-39a3-4eeb-9869-9288eea6d1c1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:59.822237 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c0eefad6-39a3-4eeb-9869-9288eea6d1c1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:59.829694 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0eefad6-39a3-4eeb-9869-9288eea6d1c1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:59.830172 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0eefad6-39a3-4eeb-9869-9288eea6d1c1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:59.830941 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0eefad6-39a3-4eeb-9869-9288eea6d1c1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:59.831379 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0eefad6-39a3-4eeb-9869-9288eea6d1c1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:59.927320 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-2a864c25-e6c6-457d-92ab-49f2edab37ed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:42:59.927941 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-2a864c25-e6c6-457d-92ab-49f2edab37ed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:42:59.935821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2a864c25-e6c6-457d-92ab-49f2edab37ed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:59.936576 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2a864c25-e6c6-457d-92ab-49f2edab37ed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:42:59.937502 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2a864c25-e6c6-457d-92ab-49f2edab37ed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:42:59.938182 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2a864c25-e6c6-457d-92ab-49f2edab37ed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:00.004221 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c0eefad6-39a3-4eeb-9869-9288eea6d1c1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:00.013250 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c0eefad6-39a3-4eeb-9869-9288eea6d1c1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.196384 Jul 12 13:43:00.014083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 83/158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:42:59 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:00.046472 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b19c4368-6bd8-4617-bfd8-9ce9340dd5bd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:00.047229 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b19c4368-6bd8-4617-bfd8-9ce9340dd5bd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:00.054912 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b19c4368-6bd8-4617-bfd8-9ce9340dd5bd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:00.055367 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b19c4368-6bd8-4617-bfd8-9ce9340dd5bd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:00.056244 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b19c4368-6bd8-4617-bfd8-9ce9340dd5bd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:00.056763 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b19c4368-6bd8-4617-bfd8-9ce9340dd5bd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:00.109324 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-2a864c25-e6c6-457d-92ab-49f2edab37ed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:00.119069 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-2a864c25-e6c6-457d-92ab-49f2edab37ed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:00.121582 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-2a864c25-e6c6-457d-92ab-49f2edab37ed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:00.123485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-2a864c25-e6c6-457d-92ab-49f2edab37ed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.200619 Jul 12 13:43:00.124469 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 76/159] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:42:59 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:43:00.201602 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b19c4368-6bd8-4617-bfd8-9ce9340dd5bd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:00.210224 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b19c4368-6bd8-4617-bfd8-9ce9340dd5bd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.167028 Jul 12 13:43:00.216731 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 84/160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:00 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:01.031235 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-46c661e4-479e-46c3-9c40-48bcf5b8098f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:01.031883 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-46c661e4-479e-46c3-9c40-48bcf5b8098f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:01.039164 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-46c661e4-479e-46c3-9c40-48bcf5b8098f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:01.039618 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-46c661e4-479e-46c3-9c40-48bcf5b8098f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:01.040387 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-46c661e4-479e-46c3-9c40-48bcf5b8098f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:01.040844 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-46c661e4-479e-46c3-9c40-48bcf5b8098f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:01.141806 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7346398e-53a5-467c-a0c7-6c8a8b4924c1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:01.142467 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7346398e-53a5-467c-a0c7-6c8a8b4924c1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:01.150009 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7346398e-53a5-467c-a0c7-6c8a8b4924c1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:01.150137 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7346398e-53a5-467c-a0c7-6c8a8b4924c1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:01.150942 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7346398e-53a5-467c-a0c7-6c8a8b4924c1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:01.151592 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7346398e-53a5-467c-a0c7-6c8a8b4924c1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:01.186670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-46c661e4-479e-46c3-9c40-48bcf5b8098f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:01.195665 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-46c661e4-479e-46c3-9c40-48bcf5b8098f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.168204 Jul 12 13:43:01.196252 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 77/161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:01 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:01.227120 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-72bb31e5-7585-443e-89e8-2d8201d066b3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:01.227869 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-72bb31e5-7585-443e-89e8-2d8201d066b3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:01.234283 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72bb31e5-7585-443e-89e8-2d8201d066b3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:01.234724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72bb31e5-7585-443e-89e8-2d8201d066b3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:01.236489 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72bb31e5-7585-443e-89e8-2d8201d066b3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:01.237082 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72bb31e5-7585-443e-89e8-2d8201d066b3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:01.386619 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-72bb31e5-7585-443e-89e8-2d8201d066b3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:01.393314 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7346398e-53a5-467c-a0c7-6c8a8b4924c1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:01.400139 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-72bb31e5-7585-443e-89e8-2d8201d066b3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.177490 Jul 12 13:43:01.400847 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 78/162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:01 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:01.401773 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7346398e-53a5-467c-a0c7-6c8a8b4924c1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:01.403339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7346398e-53a5-467c-a0c7-6c8a8b4924c1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:01.404809 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7346398e-53a5-467c-a0c7-6c8a8b4924c1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.267229 Jul 12 13:43:01.416101 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 85/163] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:43:01 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:43:02.212704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-28106adb-f914-4d63-b983-2b191d4d94bb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:02.213409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-28106adb-f914-4d63-b983-2b191d4d94bb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:02.220932 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-28106adb-f914-4d63-b983-2b191d4d94bb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:02.221387 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-28106adb-f914-4d63-b983-2b191d4d94bb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:02.222221 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-28106adb-f914-4d63-b983-2b191d4d94bb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:02.222660 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-28106adb-f914-4d63-b983-2b191d4d94bb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:02.390631 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-28106adb-f914-4d63-b983-2b191d4d94bb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:02.398248 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-28106adb-f914-4d63-b983-2b191d4d94bb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.189579 Jul 12 13:43:02.399094 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 79/164] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:02 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:02.417694 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-14c8380c-5294-44a7-a1a4-0501454476d2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:02.418689 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-14c8380c-5294-44a7-a1a4-0501454476d2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:02.427608 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14c8380c-5294-44a7-a1a4-0501454476d2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:02.428550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14c8380c-5294-44a7-a1a4-0501454476d2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:02.429590 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14c8380c-5294-44a7-a1a4-0501454476d2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:02.430405 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14c8380c-5294-44a7-a1a4-0501454476d2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:02.431460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f1778bbf-577d-4e72-9286-20f93a1354a4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:02.432090 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f1778bbf-577d-4e72-9286-20f93a1354a4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:02.439025 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f1778bbf-577d-4e72-9286-20f93a1354a4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:02.439485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f1778bbf-577d-4e72-9286-20f93a1354a4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:02.440259 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f1778bbf-577d-4e72-9286-20f93a1354a4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:02.440706 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f1778bbf-577d-4e72-9286-20f93a1354a4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:02.589734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f1778bbf-577d-4e72-9286-20f93a1354a4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:02.598522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f1778bbf-577d-4e72-9286-20f93a1354a4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:02.600838 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f1778bbf-577d-4e72-9286-20f93a1354a4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:02.602137 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f1778bbf-577d-4e72-9286-20f93a1354a4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.178784 Jul 12 13:43:02.603130 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 80/165] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:43:02 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:43:02.603309 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-14c8380c-5294-44a7-a1a4-0501454476d2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:02.611561 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-14c8380c-5294-44a7-a1a4-0501454476d2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.198160 Jul 12 13:43:02.612217 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 86/166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:02 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:03.423076 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bab58904-3918-4205-9615-042d1b1fcca9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:03.425612 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bab58904-3918-4205-9615-042d1b1fcca9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:03.435093 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bab58904-3918-4205-9615-042d1b1fcca9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:03.435967 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bab58904-3918-4205-9615-042d1b1fcca9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:03.436996 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bab58904-3918-4205-9615-042d1b1fcca9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:03.437690 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bab58904-3918-4205-9615-042d1b1fcca9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:03.639025 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d98247e8-5af7-48f2-ae6e-b9808d1b0e54 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:03.639770 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d98247e8-5af7-48f2-ae6e-b9808d1b0e54 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:03.640422 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bab58904-3918-4205-9615-042d1b1fcca9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:03.655529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bab58904-3918-4205-9615-042d1b1fcca9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.243413 Jul 12 13:43:03.656337 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d98247e8-5af7-48f2-ae6e-b9808d1b0e54 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:03.656496 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 81/167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:03 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:03.657212 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d98247e8-5af7-48f2-ae6e-b9808d1b0e54 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:03.659129 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d98247e8-5af7-48f2-ae6e-b9808d1b0e54 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:03.662118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1bd041c4-c4ca-4657-be2b-998cbb9c7c48 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:03.662548 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d98247e8-5af7-48f2-ae6e-b9808d1b0e54 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:03.662741 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1bd041c4-c4ca-4657-be2b-998cbb9c7c48 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:03.682674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1bd041c4-c4ca-4657-be2b-998cbb9c7c48 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:03.683142 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1bd041c4-c4ca-4657-be2b-998cbb9c7c48 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:03.684042 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1bd041c4-c4ca-4657-be2b-998cbb9c7c48 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:03.684488 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1bd041c4-c4ca-4657-be2b-998cbb9c7c48 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:03.834676 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d98247e8-5af7-48f2-ae6e-b9808d1b0e54 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:03.846713 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d98247e8-5af7-48f2-ae6e-b9808d1b0e54 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:03.849298 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1bd041c4-c4ca-4657-be2b-998cbb9c7c48 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:03.849681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d98247e8-5af7-48f2-ae6e-b9808d1b0e54 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:03.851270 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d98247e8-5af7-48f2-ae6e-b9808d1b0e54 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1407 microversion: 2.20 time: 0.234464 Jul 12 13:43:03.851907 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 87/168] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:43:03 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:43:03.869452 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1bd041c4-c4ca-4657-be2b-998cbb9c7c48 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.211346 Jul 12 13:43:03.869565 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 82/169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:03 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:04.672136 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7c129f40-a439-446a-a9b2-03120a147cfe tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:04.672754 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7c129f40-a439-446a-a9b2-03120a147cfe tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:04.679455 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c129f40-a439-446a-a9b2-03120a147cfe tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:04.679906 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c129f40-a439-446a-a9b2-03120a147cfe tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:04.686258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c129f40-a439-446a-a9b2-03120a147cfe tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:04.686717 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c129f40-a439-446a-a9b2-03120a147cfe tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:04.868704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d429d234-22fa-432a-baa7-15efed238ad6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:04.870375 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d429d234-22fa-432a-baa7-15efed238ad6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:04.877398 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d429d234-22fa-432a-baa7-15efed238ad6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:04.878083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d429d234-22fa-432a-baa7-15efed238ad6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:04.879038 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d429d234-22fa-432a-baa7-15efed238ad6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:04.879618 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d429d234-22fa-432a-baa7-15efed238ad6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:04.969065 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7c129f40-a439-446a-a9b2-03120a147cfe tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:04.978453 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7c129f40-a439-446a-a9b2-03120a147cfe tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1367 microversion: 2.1 time: 0.309959 Jul 12 13:43:04.979039 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 88/170] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:04 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:04.985499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-30536168-8cad-47c4-aa78-a0e7d168de5c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:04.986441 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-30536168-8cad-47c4-aa78-a0e7d168de5c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:04.996741 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-30536168-8cad-47c4-aa78-a0e7d168de5c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:04.997536 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-30536168-8cad-47c4-aa78-a0e7d168de5c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:04.998592 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-30536168-8cad-47c4-aa78-a0e7d168de5c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:04.999440 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-30536168-8cad-47c4-aa78-a0e7d168de5c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:05.059146 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d429d234-22fa-432a-baa7-15efed238ad6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:05.071878 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d429d234-22fa-432a-baa7-15efed238ad6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:05.073440 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d429d234-22fa-432a-baa7-15efed238ad6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:05.074781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d429d234-22fa-432a-baa7-15efed238ad6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1599 microversion: 2.20 time: 0.209970 Jul 12 13:43:05.075524 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 83/171] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:43:04 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:43:05.095239 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8942af92-c2e5-4e9b-a5b5-a6c2cc9cea40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:05.096039 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8942af92-c2e5-4e9b-a5b5-a6c2cc9cea40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:05.108099 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8942af92-c2e5-4e9b-a5b5-a6c2cc9cea40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:05.109170 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8942af92-c2e5-4e9b-a5b5-a6c2cc9cea40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:05.110189 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8942af92-c2e5-4e9b-a5b5-a6c2cc9cea40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:05.110840 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8942af92-c2e5-4e9b-a5b5-a6c2cc9cea40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:05.177510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-30536168-8cad-47c4-aa78-a0e7d168de5c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:05.188112 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-30536168-8cad-47c4-aa78-a0e7d168de5c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.206438 Jul 12 13:43:05.192178 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 89/172] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:04 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:05.217072 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8942af92-c2e5-4e9b-a5b5-a6c2cc9cea40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.126171 Jul 12 13:43:05.218412 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 84/173] 10.222.0.52 () {60 vars in 1315 bytes} [Tue Jul 12 13:43:05 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:43:05.999749 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6f8153f7-e27d-46f4-8b78-161b735bae09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:06.001311 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6f8153f7-e27d-46f4-8b78-161b735bae09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:06.012159 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6f8153f7-e27d-46f4-8b78-161b735bae09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:06.013012 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6f8153f7-e27d-46f4-8b78-161b735bae09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:06.013876 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6f8153f7-e27d-46f4-8b78-161b735bae09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:06.014974 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6f8153f7-e27d-46f4-8b78-161b735bae09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:06.205292 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-12f0cb4f-7e78-4c80-acb6-7ab2454042d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:06.206460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-12f0cb4f-7e78-4c80-acb6-7ab2454042d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:06.217105 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-12f0cb4f-7e78-4c80-acb6-7ab2454042d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:06.217876 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-12f0cb4f-7e78-4c80-acb6-7ab2454042d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:06.219578 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-12f0cb4f-7e78-4c80-acb6-7ab2454042d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:06.220229 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-12f0cb4f-7e78-4c80-acb6-7ab2454042d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:06.380025 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-12f0cb4f-7e78-4c80-acb6-7ab2454042d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:06.386595 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6f8153f7-e27d-46f4-8b78-161b735bae09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:06.389725 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-12f0cb4f-7e78-4c80-acb6-7ab2454042d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.188524 Jul 12 13:43:06.390693 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 85/174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:06 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:06.396434 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6f8153f7-e27d-46f4-8b78-161b735bae09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1556 microversion: 2.1 time: 0.404393 Jul 12 13:43:06.402009 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 90/175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:05 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1556 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:06.403405 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-44cd415a-dbdd-4c79-a88a-ea5d5ec6b4b9 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:06.403914 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-44cd415a-dbdd-4c79-a88a-ea5d5ec6b4b9 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:06.410955 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-44cd415a-dbdd-4c79-a88a-ea5d5ec6b4b9 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:06.411941 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-44cd415a-dbdd-4c79-a88a-ea5d5ec6b4b9 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:06.412724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-44cd415a-dbdd-4c79-a88a-ea5d5ec6b4b9 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:06.413164 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-44cd415a-dbdd-4c79-a88a-ea5d5ec6b4b9 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:06.416698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-76728e9a-340d-470c-912c-9543a2d19ed6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:06.419171 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-76728e9a-340d-470c-912c-9543a2d19ed6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:06.425995 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-76728e9a-340d-470c-912c-9543a2d19ed6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:06.426466 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-76728e9a-340d-470c-912c-9543a2d19ed6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:06.427829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-76728e9a-340d-470c-912c-9543a2d19ed6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:06.428272 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-76728e9a-340d-470c-912c-9543a2d19ed6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:06.441268 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-44cd415a-dbdd-4c79-a88a-ea5d5ec6b4b9 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:43:06.537752 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-44cd415a-dbdd-4c79-a88a-ea5d5ec6b4b9 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 204 len: 0 microversion: 2.1 time: 0.144391 Jul 12 13:43:06.538435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 86/176] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:43:06 2022] DELETE /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:43:06.548018 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b1b0a58e-c6b2-4e38-a7f2-21e91fe03d2d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:06.548731 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b1b0a58e-c6b2-4e38-a7f2-21e91fe03d2d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:06.556166 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1b0a58e-c6b2-4e38-a7f2-21e91fe03d2d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:06.556802 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1b0a58e-c6b2-4e38-a7f2-21e91fe03d2d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:06.557516 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1b0a58e-c6b2-4e38-a7f2-21e91fe03d2d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:06.558076 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1b0a58e-c6b2-4e38-a7f2-21e91fe03d2d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:06.700257 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b1b0a58e-c6b2-4e38-a7f2-21e91fe03d2d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:06.708774 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b1b0a58e-c6b2-4e38-a7f2-21e91fe03d2d tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1552 microversion: 2.1 time: 0.165194 Jul 12 13:43:06.709361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 87/177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:06 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:06.769428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-76728e9a-340d-470c-912c-9543a2d19ed6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.359107 Jul 12 13:43:06.770133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 91/178] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jul 12 13:43:06 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-interface => generated 284 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:43:06.983587 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-adbecd7d-d733-47d7-96f9-c377fb68180b req-4ec69251-881d-46cc-a883-e3b41e6c9cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71d01af-d429-48d6-9f16-6255557bdb67", "tag": "35051ab0-4751-427b-ae9e-ddc1611523c0"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:06.997585 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-adbecd7d-d733-47d7-96f9-c377fb68180b req-4ec69251-881d-46cc-a883-e3b41e6c9cfd service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:07.000493 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-adbecd7d-d733-47d7-96f9-c377fb68180b req-4ec69251-881d-46cc-a883-e3b41e6c9cfd service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:07.018393 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-adbecd7d-d733-47d7-96f9-c377fb68180b req-4ec69251-881d-46cc-a883-e3b41e6c9cfd service nova] Creating event network-changed:35051ab0-4751-427b-ae9e-ddc1611523c0 for instance e71d01af-d429-48d6-9f16-6255557bdb67 on hv-cinder-79797 Jul 12 13:43:07.024235 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-adbecd7d-d733-47d7-96f9-c377fb68180b req-4ec69251-881d-46cc-a883-e3b41e6c9cfd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044169 Jul 12 13:43:07.025294 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 88/179] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:43:07.408345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b885bc12-7eb2-45e2-a3a5-13af428ef5f9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:07.409593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b885bc12-7eb2-45e2-a3a5-13af428ef5f9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:07.416631 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b885bc12-7eb2-45e2-a3a5-13af428ef5f9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:07.418604 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b885bc12-7eb2-45e2-a3a5-13af428ef5f9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:07.419857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b885bc12-7eb2-45e2-a3a5-13af428ef5f9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:07.420521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b885bc12-7eb2-45e2-a3a5-13af428ef5f9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:07.678443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b885bc12-7eb2-45e2-a3a5-13af428ef5f9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:07.686814 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b885bc12-7eb2-45e2-a3a5-13af428ef5f9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.283920 Jul 12 13:43:07.687722 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 92/180] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:07 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:07.729929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-9bbd2d53-db75-4b1d-8794-8bf1be77c27b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:07.730650 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-9bbd2d53-db75-4b1d-8794-8bf1be77c27b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:07.738090 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9bbd2d53-db75-4b1d-8794-8bf1be77c27b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:07.738818 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9bbd2d53-db75-4b1d-8794-8bf1be77c27b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:07.740363 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9bbd2d53-db75-4b1d-8794-8bf1be77c27b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:07.740986 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9bbd2d53-db75-4b1d-8794-8bf1be77c27b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:07.811524 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:08.151533 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-9bbd2d53-db75-4b1d-8794-8bf1be77c27b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:08.161690 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-9bbd2d53-db75-4b1d-8794-8bf1be77c27b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1552 microversion: 2.1 time: 0.438845 Jul 12 13:43:08.162546 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 89/181] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:07 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1552 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:08.457527 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-ae18424b-5dde-49b9-966e-bfa33bcfecc3 req-4ab8d6a2-79a7-4710-b092-f3bd51a9c2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dedddab8-9a74-4ae7-b88c-9320b24d5440", "tag": "321278bd-a4fa-44d4-96f0-489b7d53f4d0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:08.467100 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ae18424b-5dde-49b9-966e-bfa33bcfecc3 req-4ab8d6a2-79a7-4710-b092-f3bd51a9c2e1 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:08.467478 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ae18424b-5dde-49b9-966e-bfa33bcfecc3 req-4ab8d6a2-79a7-4710-b092-f3bd51a9c2e1 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:08.481027 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-ae18424b-5dde-49b9-966e-bfa33bcfecc3 req-4ab8d6a2-79a7-4710-b092-f3bd51a9c2e1 service nova] Creating event network-changed:321278bd-a4fa-44d4-96f0-489b7d53f4d0 for instance dedddab8-9a74-4ae7-b88c-9320b24d5440 on hv-cinder-79797 Jul 12 13:43:08.487261 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-ae18424b-5dde-49b9-966e-bfa33bcfecc3 req-4ab8d6a2-79a7-4710-b092-f3bd51a9c2e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033740 Jul 12 13:43:08.487874 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 93/182] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:43:08.705342 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8bae2ba3-c510-4ea6-8a2f-7decf7cbbcbf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:08.705656 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8bae2ba3-c510-4ea6-8a2f-7decf7cbbcbf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:08.713465 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8bae2ba3-c510-4ea6-8a2f-7decf7cbbcbf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:08.714098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8bae2ba3-c510-4ea6-8a2f-7decf7cbbcbf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:08.718554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8bae2ba3-c510-4ea6-8a2f-7decf7cbbcbf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:08.719592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8bae2ba3-c510-4ea6-8a2f-7decf7cbbcbf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:08.906041 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8bae2ba3-c510-4ea6-8a2f-7decf7cbbcbf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:08.916825 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8bae2ba3-c510-4ea6-8a2f-7decf7cbbcbf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.216080 Jul 12 13:43:08.929854 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 90/183] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:08 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:09.187998 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-60deee42-9d2b-486b-a961-fe07a04fbcad tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:09.188941 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-60deee42-9d2b-486b-a961-fe07a04fbcad tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:09.195426 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60deee42-9d2b-486b-a961-fe07a04fbcad tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:09.195949 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60deee42-9d2b-486b-a961-fe07a04fbcad tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:09.196739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60deee42-9d2b-486b-a961-fe07a04fbcad tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:09.197182 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60deee42-9d2b-486b-a961-fe07a04fbcad tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:09.347685 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-60deee42-9d2b-486b-a961-fe07a04fbcad tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:09.364278 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-60deee42-9d2b-486b-a961-fe07a04fbcad tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1552 microversion: 2.1 time: 0.180768 Jul 12 13:43:09.364872 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 94/184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:09 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1552 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:09.935075 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-14ec95f6-2b1a-462a-acea-8a5a0f4b84c1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:09.935688 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-14ec95f6-2b1a-462a-acea-8a5a0f4b84c1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:09.944213 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-14ec95f6-2b1a-462a-acea-8a5a0f4b84c1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:09.944671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-14ec95f6-2b1a-462a-acea-8a5a0f4b84c1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:09.945498 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-14ec95f6-2b1a-462a-acea-8a5a0f4b84c1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:09.945936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-14ec95f6-2b1a-462a-acea-8a5a0f4b84c1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:10.140436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-14ec95f6-2b1a-462a-acea-8a5a0f4b84c1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:10.148856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-14ec95f6-2b1a-462a-acea-8a5a0f4b84c1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.217552 Jul 12 13:43:10.149630 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 91/185] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:09 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:10.381080 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a208d8a9-5a05-4f85-b2f7-42eb2711ee6f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:10.381799 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a208d8a9-5a05-4f85-b2f7-42eb2711ee6f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:10.388085 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a208d8a9-5a05-4f85-b2f7-42eb2711ee6f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:10.388560 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a208d8a9-5a05-4f85-b2f7-42eb2711ee6f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:10.389351 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a208d8a9-5a05-4f85-b2f7-42eb2711ee6f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:10.389830 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a208d8a9-5a05-4f85-b2f7-42eb2711ee6f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:10.519437 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a208d8a9-5a05-4f85-b2f7-42eb2711ee6f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:10.528181 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a208d8a9-5a05-4f85-b2f7-42eb2711ee6f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1552 microversion: 2.1 time: 0.150911 Jul 12 13:43:10.528757 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 95/186] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:10 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:11.165862 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-be9cb211-8210-4edd-baff-05b5799d516b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:11.166502 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-be9cb211-8210-4edd-baff-05b5799d516b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:11.172975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be9cb211-8210-4edd-baff-05b5799d516b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:11.173419 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be9cb211-8210-4edd-baff-05b5799d516b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:11.174218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be9cb211-8210-4edd-baff-05b5799d516b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:11.174646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be9cb211-8210-4edd-baff-05b5799d516b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:11.320856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-be9cb211-8210-4edd-baff-05b5799d516b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:11.328688 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-be9cb211-8210-4edd-baff-05b5799d516b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.166740 Jul 12 13:43:11.329263 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 92/187] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:11 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:11.546958 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-40e2bdd8-ce6c-483b-919c-fef791ffcd07 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:11.547567 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-40e2bdd8-ce6c-483b-919c-fef791ffcd07 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:11.554669 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40e2bdd8-ce6c-483b-919c-fef791ffcd07 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:11.555297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40e2bdd8-ce6c-483b-919c-fef791ffcd07 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:11.556221 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40e2bdd8-ce6c-483b-919c-fef791ffcd07 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:11.556811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40e2bdd8-ce6c-483b-919c-fef791ffcd07 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:11.858787 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-40e2bdd8-ce6c-483b-919c-fef791ffcd07 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:11.871714 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-40e2bdd8-ce6c-483b-919c-fef791ffcd07 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1552 microversion: 2.1 time: 0.328433 Jul 12 13:43:11.874758 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 96/188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:11 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1552 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:12.182966 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-13496f1e-ab1b-4fd4-98e2-5ab8df7b6128 req-92025013-218f-4a4a-a41c-85003077d304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89e1992-2407-4b9b-b805-2e68237ddc96", "name": "network-vif-deleted", "tag": "4fe708d1-0106-46fa-a5fc-1441af3d9f78"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:12.194451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-13496f1e-ab1b-4fd4-98e2-5ab8df7b6128 req-92025013-218f-4a4a-a41c-85003077d304 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:12.195496 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-13496f1e-ab1b-4fd4-98e2-5ab8df7b6128 req-92025013-218f-4a4a-a41c-85003077d304 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:12.218768 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-13496f1e-ab1b-4fd4-98e2-5ab8df7b6128 req-92025013-218f-4a4a-a41c-85003077d304 service nova] Creating event network-vif-deleted:4fe708d1-0106-46fa-a5fc-1441af3d9f78 for instance b89e1992-2407-4b9b-b805-2e68237ddc96 on hv-cinder-79797 Jul 12 13:43:12.225648 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-13496f1e-ab1b-4fd4-98e2-5ab8df7b6128 req-92025013-218f-4a4a-a41c-85003077d304 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049077 Jul 12 13:43:12.226422 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 93/189] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:43:12.346133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0259a3be-ddbb-4562-ad27-5b22dea346d3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:12.346766 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0259a3be-ddbb-4562-ad27-5b22dea346d3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:12.352898 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0259a3be-ddbb-4562-ad27-5b22dea346d3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:12.353339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0259a3be-ddbb-4562-ad27-5b22dea346d3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:12.354120 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0259a3be-ddbb-4562-ad27-5b22dea346d3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:12.354552 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0259a3be-ddbb-4562-ad27-5b22dea346d3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:12.507191 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0259a3be-ddbb-4562-ad27-5b22dea346d3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:12.515080 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0259a3be-ddbb-4562-ad27-5b22dea346d3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.172832 Jul 12 13:43:12.515743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 97/190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:12 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:12.891037 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:12.891736 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:12.897983 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:12.898456 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:12.899219 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:12.899660 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:12.929785 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:12.930264 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:12.930714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lazy-loading 'fault' on Instance uuid b89e1992-2407-4b9b-b805-2e68237ddc96 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:43:12.974898 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25bdc429c3c4f8ba33ee4042f128c8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f5464e5ca174b398ebb28ad3e8a84f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:12.983007 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c97a25bf-178b-4722-a645-049e07690b00 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 200 len: 1349 microversion: 2.1 time: 0.096122 Jul 12 13:43:12.983774 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 94/191] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:12 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:13.532265 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8da81d10-3c22-4511-9373-c22f253b66dc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:13.532904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8da81d10-3c22-4511-9373-c22f253b66dc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:13.539453 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8da81d10-3c22-4511-9373-c22f253b66dc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:13.539899 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8da81d10-3c22-4511-9373-c22f253b66dc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:13.540655 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8da81d10-3c22-4511-9373-c22f253b66dc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:13.541091 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8da81d10-3c22-4511-9373-c22f253b66dc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:13.676885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8da81d10-3c22-4511-9373-c22f253b66dc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:13.684730 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8da81d10-3c22-4511-9373-c22f253b66dc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.156183 Jul 12 13:43:13.685383 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 98/192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:13 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:14.000759 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-066649eb-86a2-4c51-bdf3-d6dce12dfb1f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:14.001722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-066649eb-86a2-4c51-bdf3-d6dce12dfb1f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:14.009159 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-066649eb-86a2-4c51-bdf3-d6dce12dfb1f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:14.009619 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-066649eb-86a2-4c51-bdf3-d6dce12dfb1f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:14.010477 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-066649eb-86a2-4c51-bdf3-d6dce12dfb1f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:14.010946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-066649eb-86a2-4c51-bdf3-d6dce12dfb1f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:14.024897 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-066649eb-86a2-4c51-bdf3-d6dce12dfb1f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] HTTP exception thrown: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-066649eb-86a2-4c51-bdf3-d6dce12dfb1f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Request method failure captured: Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 HTTP/1.1 Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXoru3sYyX_xtR_kZIr8r-e27LXpQcVlUQgy5Tnhm3LRkXCZUgB4CFS7KhS5eHsRz_UcaIii3bmeGSJ0_ptKdjHLN5ASzTqABAcvW7wiuklGqiYftgLjgK41O5vLRkKcP13jYl9BlhESnJJZ_8dZfeoyqgu5F3WcNlZ2Sdy-UVXQL9c Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 3f5464e5ca174b398ebb28ad3e8a84f1 Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:43:14.029473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 3f5464e5ca174b398ebb28ad3e8a84f1 Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-DeleteServersTestJSON-191420892-project Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: c25bdc429c3c4f8ba33ee4042f128c8e Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-DeleteServersTestJSON-191420892-project Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:14.030975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'b89e1992-2407-4b9b-b805-2e68237ddc96'} Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:43:14.031735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:14.032800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:14.033736 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-066649eb-86a2-4c51-bdf3-d6dce12dfb1f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Returning 404 to user: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:43:14.033736 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-066649eb-86a2-4c51-bdf3-d6dce12dfb1f tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 404 len: 111 microversion: 2.1 time: 0.034083 Jul 12 13:43:14.033736 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 95/193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:13 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:43:14.268522 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3a5b1354-51b3-4f3c-8f98-20b61967e2a7 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:14.271200 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3a5b1354-51b3-4f3c-8f98-20b61967e2a7 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:14.277926 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a5b1354-51b3-4f3c-8f98-20b61967e2a7 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:14.278407 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a5b1354-51b3-4f3c-8f98-20b61967e2a7 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:14.279168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a5b1354-51b3-4f3c-8f98-20b61967e2a7 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:14.279598 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a5b1354-51b3-4f3c-8f98-20b61967e2a7 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:14.294368 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-3a5b1354-51b3-4f3c-8f98-20b61967e2a7 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] HTTP exception thrown: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3a5b1354-51b3-4f3c-8f98-20b61967e2a7 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Request method failure captured: Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96/os-volume_attachments HTTP/1.1 Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXoru3sYyX_xtR_kZIr8r-e27LXpQcVlUQgy5Tnhm3LRkXCZUgB4CFS7KhS5eHsRz_UcaIii3bmeGSJ0_ptKdjHLN5ASzTqABAcvW7wiuklGqiYftgLjgK41O5vLRkKcP13jYl9BlhESnJJZ_8dZfeoyqgu5F3WcNlZ2Sdy-UVXQL9c Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 3f5464e5ca174b398ebb28ad3e8a84f1 Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:43:14.299302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 3f5464e5ca174b398ebb28ad3e8a84f1 Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-DeleteServersTestJSON-191420892-project Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: c25bdc429c3c4f8ba33ee4042f128c8e Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-DeleteServersTestJSON-191420892-project Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:14.300499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'server_id': 'b89e1992-2407-4b9b-b805-2e68237ddc96'} Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:43:14.301196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:14.303408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:43:14.304749 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3a5b1354-51b3-4f3c-8f98-20b61967e2a7 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Returning 404 to user: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:43:14.304749 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3a5b1354-51b3-4f3c-8f98-20b61967e2a7 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036305 Jul 12 13:43:14.307611 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 99/194] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:43:14 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:43:14.702210 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c77f837a-bbc8-4338-959f-8195781d4e30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:14.702828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c77f837a-bbc8-4338-959f-8195781d4e30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:14.708941 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c77f837a-bbc8-4338-959f-8195781d4e30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:14.709419 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c77f837a-bbc8-4338-959f-8195781d4e30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:14.710219 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c77f837a-bbc8-4338-959f-8195781d4e30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:14.710661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c77f837a-bbc8-4338-959f-8195781d4e30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:14.865004 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c77f837a-bbc8-4338-959f-8195781d4e30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:14.875358 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c77f837a-bbc8-4338-959f-8195781d4e30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.177226 Jul 12 13:43:14.882944 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 96/195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:14 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:15.512128 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b92f7d9e-42bd-4b04-bade-e0b4dbfff67b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:15.512637 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b92f7d9e-42bd-4b04-bade-e0b4dbfff67b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:15.519068 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b92f7d9e-42bd-4b04-bade-e0b4dbfff67b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:15.519806 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b92f7d9e-42bd-4b04-bade-e0b4dbfff67b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:15.521163 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b92f7d9e-42bd-4b04-bade-e0b4dbfff67b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:15.522239 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b92f7d9e-42bd-4b04-bade-e0b4dbfff67b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:15.536090 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-b92f7d9e-42bd-4b04-bade-e0b4dbfff67b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] HTTP exception thrown: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b92f7d9e-42bd-4b04-bade-e0b4dbfff67b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Request method failure captured: Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 HTTP/1.1 Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXoru3sYyX_xtR_kZIr8r-e27LXpQcVlUQgy5Tnhm3LRkXCZUgB4CFS7KhS5eHsRz_UcaIii3bmeGSJ0_ptKdjHLN5ASzTqABAcvW7wiuklGqiYftgLjgK41O5vLRkKcP13jYl9BlhESnJJZ_8dZfeoyqgu5F3WcNlZ2Sdy-UVXQL9c Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 3f5464e5ca174b398ebb28ad3e8a84f1 Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:43:15.538583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 3f5464e5ca174b398ebb28ad3e8a84f1 Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-DeleteServersTestJSON-191420892-project Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: c25bdc429c3c4f8ba33ee4042f128c8e Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-DeleteServersTestJSON-191420892-project Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:15.540006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'b89e1992-2407-4b9b-b805-2e68237ddc96'} Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:43:15.540647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:15.541671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:43:15.542942 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b92f7d9e-42bd-4b04-bade-e0b4dbfff67b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Returning 404 to user: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:43:15.542942 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b92f7d9e-42bd-4b04-bade-e0b4dbfff67b tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 404 len: 111 microversion: 2.1 time: 0.031653 Jul 12 13:43:15.542942 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 100/196] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:43:15 2022] DELETE /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:43:15.550004 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e3b7c610-d28f-452b-bc5f-ff8ba8037828 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:15.550608 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e3b7c610-d28f-452b-bc5f-ff8ba8037828 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] [instance: b89e1992-2407-4b9b-b805-2e68237ddc96] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:15.557193 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e3b7c610-d28f-452b-bc5f-ff8ba8037828 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:15.557638 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e3b7c610-d28f-452b-bc5f-ff8ba8037828 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:15.558431 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e3b7c610-d28f-452b-bc5f-ff8ba8037828 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:15.558860 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e3b7c610-d28f-452b-bc5f-ff8ba8037828 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:15.572724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-e3b7c610-d28f-452b-bc5f-ff8ba8037828 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] HTTP exception thrown: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e3b7c610-d28f-452b-bc5f-ff8ba8037828 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Request method failure captured: Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 HTTP/1.1 Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXoru3sYyX_xtR_kZIr8r-e27LXpQcVlUQgy5Tnhm3LRkXCZUgB4CFS7KhS5eHsRz_UcaIii3bmeGSJ0_ptKdjHLN5ASzTqABAcvW7wiuklGqiYftgLjgK41O5vLRkKcP13jYl9BlhESnJJZ_8dZfeoyqgu5F3WcNlZ2Sdy-UVXQL9c Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 3f5464e5ca174b398ebb28ad3e8a84f1 Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:43:15.574430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3f5464e5ca174b398ebb28ad3e8a84f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 3f5464e5ca174b398ebb28ad3e8a84f1 Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-DeleteServersTestJSON-191420892 Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-DeleteServersTestJSON-191420892-project Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: c25bdc429c3c4f8ba33ee4042f128c8e Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-DeleteServersTestJSON-191420892-project Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:15.575817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'b89e1992-2407-4b9b-b805-2e68237ddc96'} Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:43:15.576610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. Jul 12 13:43:15.578580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:15.580126 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e3b7c610-d28f-452b-bc5f-ff8ba8037828 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] Returning 404 to user: Instance b89e1992-2407-4b9b-b805-2e68237ddc96 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:43:15.580126 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e3b7c610-d28f-452b-bc5f-ff8ba8037828 tempest-DeleteServersTestJSON-191420892 tempest-DeleteServersTestJSON-191420892-project] 10.222.0.52 "GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96" status: 404 len: 111 microversion: 2.1 time: 0.029736 Jul 12 13:43:15.580435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 97/197] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:15 2022] GET /compute/v2.1/servers/b89e1992-2407-4b9b-b805-2e68237ddc96 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:43:15.899918 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a4cce401-7ad8-45c6-9f91-a41ecbe2d59f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:15.900692 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a4cce401-7ad8-45c6-9f91-a41ecbe2d59f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:15.907298 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4cce401-7ad8-45c6-9f91-a41ecbe2d59f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:15.907732 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4cce401-7ad8-45c6-9f91-a41ecbe2d59f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:15.908509 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4cce401-7ad8-45c6-9f91-a41ecbe2d59f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:15.908963 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a4cce401-7ad8-45c6-9f91-a41ecbe2d59f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:16.206169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a4cce401-7ad8-45c6-9f91-a41ecbe2d59f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:16.210573 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:16.215953 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a4cce401-7ad8-45c6-9f91-a41ecbe2d59f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.321004 Jul 12 13:43:16.216628 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 101/198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:15 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:17.235920 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7b8fff21-3107-4a83-b594-6866a6742080 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:17.236526 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7b8fff21-3107-4a83-b594-6866a6742080 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:17.249366 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7b8fff21-3107-4a83-b594-6866a6742080 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:17.250177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7b8fff21-3107-4a83-b594-6866a6742080 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:17.251135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7b8fff21-3107-4a83-b594-6866a6742080 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:17.251969 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7b8fff21-3107-4a83-b594-6866a6742080 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:17.724146 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7b8fff21-3107-4a83-b594-6866a6742080 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:17.734834 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7b8fff21-3107-4a83-b594-6866a6742080 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.505361 Jul 12 13:43:17.735904 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 98/199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:17 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:18.755643 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fa3eb9a4-daa1-48e5-a137-9d9fde2e7884 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:18.756268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fa3eb9a4-daa1-48e5-a137-9d9fde2e7884 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:18.767313 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa3eb9a4-daa1-48e5-a137-9d9fde2e7884 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:18.770606 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa3eb9a4-daa1-48e5-a137-9d9fde2e7884 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:18.771836 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa3eb9a4-daa1-48e5-a137-9d9fde2e7884 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:18.772489 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa3eb9a4-daa1-48e5-a137-9d9fde2e7884 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:19.226378 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fa3eb9a4-daa1-48e5-a137-9d9fde2e7884 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:19.234478 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fa3eb9a4-daa1-48e5-a137-9d9fde2e7884 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.483875 Jul 12 13:43:19.235059 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 102/200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:18 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:20.264397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e45c2ce9-0663-45c7-a252-b305fc8022f4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:20.265829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e45c2ce9-0663-45c7-a252-b305fc8022f4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:20.281560 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e45c2ce9-0663-45c7-a252-b305fc8022f4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:20.282035 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e45c2ce9-0663-45c7-a252-b305fc8022f4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:20.282820 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e45c2ce9-0663-45c7-a252-b305fc8022f4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:20.283267 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e45c2ce9-0663-45c7-a252-b305fc8022f4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:20.651460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e45c2ce9-0663-45c7-a252-b305fc8022f4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:20.663038 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e45c2ce9-0663-45c7-a252-b305fc8022f4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.414178 Jul 12 13:43:20.663703 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 99/201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:20 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:21.680790 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ec7896e0-13e8-4b09-9f2c-888a387d3c2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:21.682307 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ec7896e0-13e8-4b09-9f2c-888a387d3c2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:21.694438 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec7896e0-13e8-4b09-9f2c-888a387d3c2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:21.697803 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec7896e0-13e8-4b09-9f2c-888a387d3c2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:21.698726 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec7896e0-13e8-4b09-9f2c-888a387d3c2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:21.700711 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec7896e0-13e8-4b09-9f2c-888a387d3c2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:22.273239 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ec7896e0-13e8-4b09-9f2c-888a387d3c2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:22.284925 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ec7896e0-13e8-4b09-9f2c-888a387d3c2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.608722 Jul 12 13:43:22.286817 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 103/202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:21 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:23.304679 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-76b41d25-2782-4ab1-96b2-372aa887028d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:23.305418 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-76b41d25-2782-4ab1-96b2-372aa887028d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:23.314543 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:23.319367 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-76b41d25-2782-4ab1-96b2-372aa887028d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:23.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-76b41d25-2782-4ab1-96b2-372aa887028d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:23.321090 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-76b41d25-2782-4ab1-96b2-372aa887028d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:23.323781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-76b41d25-2782-4ab1-96b2-372aa887028d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:23.836946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-76b41d25-2782-4ab1-96b2-372aa887028d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:23.873832 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-76b41d25-2782-4ab1-96b2-372aa887028d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.571726 Jul 12 13:43:23.874970 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 100/203] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:23 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:24.892046 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f680f2ae-bac3-4925-9195-d68f11051faa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:24.893296 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f680f2ae-bac3-4925-9195-d68f11051faa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:24.900449 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f680f2ae-bac3-4925-9195-d68f11051faa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:24.901101 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f680f2ae-bac3-4925-9195-d68f11051faa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:24.902160 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f680f2ae-bac3-4925-9195-d68f11051faa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:24.902793 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f680f2ae-bac3-4925-9195-d68f11051faa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:25.256470 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f680f2ae-bac3-4925-9195-d68f11051faa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:25.271712 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f680f2ae-bac3-4925-9195-d68f11051faa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.384729 Jul 12 13:43:25.287938 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 104/204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:24 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:26.305663 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a9d45cbd-6ce6-4ad1-bb5e-6e0f9695d8d8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:26.306469 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a9d45cbd-6ce6-4ad1-bb5e-6e0f9695d8d8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:26.320757 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a9d45cbd-6ce6-4ad1-bb5e-6e0f9695d8d8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:26.323200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a9d45cbd-6ce6-4ad1-bb5e-6e0f9695d8d8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:26.325060 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a9d45cbd-6ce6-4ad1-bb5e-6e0f9695d8d8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:26.326702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a9d45cbd-6ce6-4ad1-bb5e-6e0f9695d8d8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:26.721150 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a9d45cbd-6ce6-4ad1-bb5e-6e0f9695d8d8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:26.730855 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a9d45cbd-6ce6-4ad1-bb5e-6e0f9695d8d8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.431621 Jul 12 13:43:26.746061 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 101/205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:26 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:27.752597 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6a086e27-71e1-4cd3-a1c0-a63940481c4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:27.753883 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6a086e27-71e1-4cd3-a1c0-a63940481c4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:27.762271 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=57 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:27.768524 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a086e27-71e1-4cd3-a1c0-a63940481c4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:27.769268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a086e27-71e1-4cd3-a1c0-a63940481c4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:27.772054 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a086e27-71e1-4cd3-a1c0-a63940481c4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:27.772728 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6a086e27-71e1-4cd3-a1c0-a63940481c4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:28.281709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6a086e27-71e1-4cd3-a1c0-a63940481c4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:28.297793 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6a086e27-71e1-4cd3-a1c0-a63940481c4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.549661 Jul 12 13:43:28.311840 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 105/206] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:27 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:29.335622 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-267f1597-d7a9-48a7-a91a-fb94738046ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:29.340155 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-267f1597-d7a9-48a7-a91a-fb94738046ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:29.367143 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-267f1597-d7a9-48a7-a91a-fb94738046ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:29.368600 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-267f1597-d7a9-48a7-a91a-fb94738046ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:29.371169 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-267f1597-d7a9-48a7-a91a-fb94738046ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:29.372463 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-267f1597-d7a9-48a7-a91a-fb94738046ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:29.731992 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-267f1597-d7a9-48a7-a91a-fb94738046ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:29.740630 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-267f1597-d7a9-48a7-a91a-fb94738046ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.414989 Jul 12 13:43:29.748498 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 102/207] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:29 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:30.771613 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-00850145-eb7f-4a33-90b0-3eae182cca29 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:30.772220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-00850145-eb7f-4a33-90b0-3eae182cca29 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:30.779148 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00850145-eb7f-4a33-90b0-3eae182cca29 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:30.783921 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00850145-eb7f-4a33-90b0-3eae182cca29 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:30.784976 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00850145-eb7f-4a33-90b0-3eae182cca29 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:30.787791 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00850145-eb7f-4a33-90b0-3eae182cca29 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:31.067654 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-00850145-eb7f-4a33-90b0-3eae182cca29 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:31.085120 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-00850145-eb7f-4a33-90b0-3eae182cca29 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.318203 Jul 12 13:43:31.087149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 106/208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:30 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:31.308786 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-20b787b6-5ee1-4489-a179-f90f8d95ceda tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Action: 'create', calling method: .version_select at 0x7f3a15ed1e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2014345130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGab8JwmJ+f5Bc6iA0u0Xuw0YbFQDtnl1Zr0uRddAXvM7fgtNcU4kv5U0jghNz9AqTVvPfrZDCR1MvmfGwJZNgwSpyaLBxiX8UUQBfExiJPi1A5WBvcxIr+Evekd0d++A=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:31.352426 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-20b787b6-5ee1-4489-a179-f90f8d95ceda tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Getting quotas for project edae8cd268da40a3b8e2affe277bc56e. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:43:31.362098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-20b787b6-5ee1-4489-a179-f90f8d95ceda tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Getting quotas for user bb11db914a57439bada24b5f755a143a and project edae8cd268da40a3b8e2affe277bc56e. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:43:31.403304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-20b787b6-5ee1-4489-a179-f90f8d95ceda tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.516360 Jul 12 13:43:31.404505 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 103/209] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jul 12 13:43:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:43:32.107902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-127b4137-8174-4333-888d-de4adf12c600 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:32.108963 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-127b4137-8174-4333-888d-de4adf12c600 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:32.133521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-127b4137-8174-4333-888d-de4adf12c600 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:32.134475 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-127b4137-8174-4333-888d-de4adf12c600 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:32.153237 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-127b4137-8174-4333-888d-de4adf12c600 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:32.153754 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-127b4137-8174-4333-888d-de4adf12c600 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:32.548646 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-127b4137-8174-4333-888d-de4adf12c600 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:32.561914 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-127b4137-8174-4333-888d-de4adf12c600 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.461147 Jul 12 13:43:32.562903 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 107/210] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:32 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:33.601737 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-279ff5c5-a1b3-4141-a0e6-7f4310109b3e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:33.603983 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-279ff5c5-a1b3-4141-a0e6-7f4310109b3e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:33.616747 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-279ff5c5-a1b3-4141-a0e6-7f4310109b3e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:33.619118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-279ff5c5-a1b3-4141-a0e6-7f4310109b3e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:33.623361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-279ff5c5-a1b3-4141-a0e6-7f4310109b3e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:33.624883 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-279ff5c5-a1b3-4141-a0e6-7f4310109b3e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:33.776454 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1725311106", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "networks": [{"uuid": "626c6cea-7728-4107-9956-7f258a8aef06"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:33.873698 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-279ff5c5-a1b3-4141-a0e6-7f4310109b3e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:33.882326 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-279ff5c5-a1b3-4141-a0e6-7f4310109b3e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.305327 Jul 12 13:43:33.882799 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 104/211] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:33 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:33.896241 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] validate_networks() for [('626c6cea-7728-4107-9956-7f258a8aef06', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:43:34.348740 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:43:34.349166 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:43:34.349746 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:43:34.350224 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:43:34.350644 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:43:34.365634 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:34.366183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:34.366975 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:34.367502 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:34.389070 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Getting quotas for project 4f3ab1e8d5fd4ac7b34c60a4a3cf9c45. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:43:34.396635 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Getting quotas for user 287144c6346a43d09cdbae463ca9a961 and project 4f3ab1e8d5fd4ac7b34c60a4a3cf9c45. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:43:34.412452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:43:34.414903 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:43:34.475584 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-433b7b80-6ad8-4f61-80ae-b0c1a02ccafb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702908 Jul 12 13:43:34.476905 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 108/212] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:43:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 13:43:34.490589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f481e4d9-c9e3-49f6-ae48-49865a3dd7db tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:34.491745 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f481e4d9-c9e3-49f6-ae48-49865a3dd7db tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:34.567205 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f481e4d9-c9e3-49f6-ae48-49865a3dd7db tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:34.589188 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f481e4d9-c9e3-49f6-ae48-49865a3dd7db tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1214 microversion: 2.1 time: 0.102772 Jul 12 13:43:34.590220 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 105/213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:34 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:34.899487 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-00da3a60-2ff8-4ffa-ad3b-6a02dc3f4709 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:34.900480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-00da3a60-2ff8-4ffa-ad3b-6a02dc3f4709 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:34.907789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00da3a60-2ff8-4ffa-ad3b-6a02dc3f4709 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:34.908527 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00da3a60-2ff8-4ffa-ad3b-6a02dc3f4709 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:34.909398 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00da3a60-2ff8-4ffa-ad3b-6a02dc3f4709 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:34.909937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-00da3a60-2ff8-4ffa-ad3b-6a02dc3f4709 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:35.070836 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-00da3a60-2ff8-4ffa-ad3b-6a02dc3f4709 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:35.081106 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-00da3a60-2ff8-4ffa-ad3b-6a02dc3f4709 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.185644 Jul 12 13:43:35.081712 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 109/214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:34 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:35.606658 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a7978019-8635-4ec1-a452-e554c9fb3b26 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:35.607798 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a7978019-8635-4ec1-a452-e554c9fb3b26 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:35.618017 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a7978019-8635-4ec1-a452-e554c9fb3b26 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:35.621051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a7978019-8635-4ec1-a452-e554c9fb3b26 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:35.622079 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a7978019-8635-4ec1-a452-e554c9fb3b26 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:35.622529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a7978019-8635-4ec1-a452-e554c9fb3b26 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:35.706759 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a7978019-8635-4ec1-a452-e554c9fb3b26 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:35.716590 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a7978019-8635-4ec1-a452-e554c9fb3b26 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1266 microversion: 2.1 time: 0.113924 Jul 12 13:43:35.717166 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 106/215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:35 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:36.108829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fd57b829-e983-47f9-a663-399893ae4b45 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:36.110387 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fd57b829-e983-47f9-a663-399893ae4b45 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:36.119779 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fd57b829-e983-47f9-a663-399893ae4b45 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:36.124322 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fd57b829-e983-47f9-a663-399893ae4b45 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:36.125152 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fd57b829-e983-47f9-a663-399893ae4b45 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:36.125601 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fd57b829-e983-47f9-a663-399893ae4b45 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:36.343768 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fd57b829-e983-47f9-a663-399893ae4b45 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:36.353974 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fd57b829-e983-47f9-a663-399893ae4b45 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1521 microversion: 2.1 time: 0.259793 Jul 12 13:43:36.370457 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 110/216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:36 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:36.739278 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c6c53757-ea8e-4ef3-8fe4-1fa2360abb3b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:36.741433 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c6c53757-ea8e-4ef3-8fe4-1fa2360abb3b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:36.752389 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c6c53757-ea8e-4ef3-8fe4-1fa2360abb3b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:36.753711 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c6c53757-ea8e-4ef3-8fe4-1fa2360abb3b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:36.755609 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c6c53757-ea8e-4ef3-8fe4-1fa2360abb3b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:36.756923 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c6c53757-ea8e-4ef3-8fe4-1fa2360abb3b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:36.889704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c6c53757-ea8e-4ef3-8fe4-1fa2360abb3b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:36.912301 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c6c53757-ea8e-4ef3-8fe4-1fa2360abb3b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1272 microversion: 2.1 time: 0.179865 Jul 12 13:43:36.912977 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 107/217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:36 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:37.376977 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-40439804-aba7-4ca6-b14d-b8181c9be672 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:37.377681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-40439804-aba7-4ca6-b14d-b8181c9be672 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:37.392477 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40439804-aba7-4ca6-b14d-b8181c9be672 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:37.392998 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40439804-aba7-4ca6-b14d-b8181c9be672 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:37.405023 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40439804-aba7-4ca6-b14d-b8181c9be672 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:37.405606 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40439804-aba7-4ca6-b14d-b8181c9be672 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:37.693242 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-40439804-aba7-4ca6-b14d-b8181c9be672 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:37.710330 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-40439804-aba7-4ca6-b14d-b8181c9be672 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1501 microversion: 2.1 time: 0.335317 Jul 12 13:43:37.711034 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 111/218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:37 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1501 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:37.726673 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8a850642-aab1-41f8-96bc-2e0a3e40f599 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:37.727292 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8a850642-aab1-41f8-96bc-2e0a3e40f599 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:37.736463 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a850642-aab1-41f8-96bc-2e0a3e40f599 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:37.736908 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a850642-aab1-41f8-96bc-2e0a3e40f599 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:37.737701 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a850642-aab1-41f8-96bc-2e0a3e40f599 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:37.738160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a850642-aab1-41f8-96bc-2e0a3e40f599 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:37.930145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-60f9e457-fbfd-4ce5-ad47-233da2318bec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:37.930750 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-60f9e457-fbfd-4ce5-ad47-233da2318bec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:37.942362 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60f9e457-fbfd-4ce5-ad47-233da2318bec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:37.942810 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60f9e457-fbfd-4ce5-ad47-233da2318bec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:37.943888 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60f9e457-fbfd-4ce5-ad47-233da2318bec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:37.944324 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60f9e457-fbfd-4ce5-ad47-233da2318bec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:37.954831 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8a850642-aab1-41f8-96bc-2e0a3e40f599 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:37.959032 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=94 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:37.964714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8a850642-aab1-41f8-96bc-2e0a3e40f599 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1517 microversion: 2.1 time: 0.242130 Jul 12 13:43:37.971110 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 108/219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:37 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1517 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:38.070678 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-60f9e457-fbfd-4ce5-ad47-233da2318bec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:38.078793 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-60f9e457-fbfd-4ce5-ad47-233da2318bec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1272 microversion: 2.1 time: 0.152466 Jul 12 13:43:38.079370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 112/220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:37 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:38.968210 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-a7e2459b-d11a-4ed8-ac61-37f85dc2a5e9 req-5822b82d-e5ad-4528-a6c2-a83284df4c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f796dc30-ede4-4ea0-8baa-6f0144831067", "tag": "aad7cbc8-64c6-4126-a418-421e2077034a"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:38.994820 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-a7e2459b-d11a-4ed8-ac61-37f85dc2a5e9 req-5822b82d-e5ad-4528-a6c2-a83284df4c5c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:38.995509 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-a7e2459b-d11a-4ed8-ac61-37f85dc2a5e9 req-5822b82d-e5ad-4528-a6c2-a83284df4c5c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:39.014190 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-a7e2459b-d11a-4ed8-ac61-37f85dc2a5e9 req-5822b82d-e5ad-4528-a6c2-a83284df4c5c service nova] Creating event network-changed:aad7cbc8-64c6-4126-a418-421e2077034a for instance f796dc30-ede4-4ea0-8baa-6f0144831067 on hv-cinder-79797 Jul 12 13:43:39.021441 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-a7e2459b-d11a-4ed8-ac61-37f85dc2a5e9 req-5822b82d-e5ad-4528-a6c2-a83284df4c5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056391 Jul 12 13:43:39.022698 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 109/221] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:43:39.095555 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-83f3ee9a-1b95-4c73-92d5-e268eee3878a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:39.096403 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-83f3ee9a-1b95-4c73-92d5-e268eee3878a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:39.102697 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83f3ee9a-1b95-4c73-92d5-e268eee3878a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:39.103291 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83f3ee9a-1b95-4c73-92d5-e268eee3878a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:39.104159 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83f3ee9a-1b95-4c73-92d5-e268eee3878a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:39.104672 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83f3ee9a-1b95-4c73-92d5-e268eee3878a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:39.264381 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-83f3ee9a-1b95-4c73-92d5-e268eee3878a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:39.274261 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-83f3ee9a-1b95-4c73-92d5-e268eee3878a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1314 microversion: 2.1 time: 0.182420 Jul 12 13:43:39.274841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 113/222] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:39 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:39.417037 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-68a0b8f6-ca4a-45ce-a18b-15ac6f559cff tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:39.418030 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-68a0b8f6-ca4a-45ce-a18b-15ac6f559cff tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:39.425401 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-68a0b8f6-ca4a-45ce-a18b-15ac6f559cff tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:39.426516 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-68a0b8f6-ca4a-45ce-a18b-15ac6f559cff tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:39.427369 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-68a0b8f6-ca4a-45ce-a18b-15ac6f559cff tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:39.427918 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-68a0b8f6-ca4a-45ce-a18b-15ac6f559cff tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:39.453332 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-68a0b8f6-ca4a-45ce-a18b-15ac6f559cff tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lazy-loading 'flavor' on Instance uuid 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:43:39.545007 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-68a0b8f6-ca4a-45ce-a18b-15ac6f559cff tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33/action" status: 200 len: 32 microversion: 2.1 time: 0.132473 Jul 12 13:43:39.545930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 110/223] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:43:39 2022] POST /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33/action => generated 32 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:43:39.555476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d1e3b070-bb64-47e6-9518-7bee25bdd651 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:39.556660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d1e3b070-bb64-47e6-9518-7bee25bdd651 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:39.562115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e3b070-bb64-47e6-9518-7bee25bdd651 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:39.562566 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e3b070-bb64-47e6-9518-7bee25bdd651 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:39.563328 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e3b070-bb64-47e6-9518-7bee25bdd651 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:39.563800 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e3b070-bb64-47e6-9518-7bee25bdd651 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:39.702311 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d1e3b070-bb64-47e6-9518-7bee25bdd651 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:39.711251 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d1e3b070-bb64-47e6-9518-7bee25bdd651 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.160115 Jul 12 13:43:39.712185 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 114/224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:39 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:40.291199 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e0db8349-1bf4-4e3b-bcea-62f9f66dd851 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:40.291900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e0db8349-1bf4-4e3b-bcea-62f9f66dd851 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:40.299281 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e0db8349-1bf4-4e3b-bcea-62f9f66dd851 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:40.299737 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e0db8349-1bf4-4e3b-bcea-62f9f66dd851 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:40.300509 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e0db8349-1bf4-4e3b-bcea-62f9f66dd851 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:40.300978 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e0db8349-1bf4-4e3b-bcea-62f9f66dd851 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:40.446822 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e0db8349-1bf4-4e3b-bcea-62f9f66dd851 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:40.454444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e0db8349-1bf4-4e3b-bcea-62f9f66dd851 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1314 microversion: 2.1 time: 0.167847 Jul 12 13:43:40.455418 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 111/225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:40 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:40.728877 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d8f1293a-21cc-462c-b7c8-d24b9bcb31ad tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:40.729479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d8f1293a-21cc-462c-b7c8-d24b9bcb31ad tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:40.735590 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d8f1293a-21cc-462c-b7c8-d24b9bcb31ad tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:40.736159 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d8f1293a-21cc-462c-b7c8-d24b9bcb31ad tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:40.736923 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d8f1293a-21cc-462c-b7c8-d24b9bcb31ad tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:40.737353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d8f1293a-21cc-462c-b7c8-d24b9bcb31ad tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:40.982134 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d8f1293a-21cc-462c-b7c8-d24b9bcb31ad tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:40.993545 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d8f1293a-21cc-462c-b7c8-d24b9bcb31ad tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.268186 Jul 12 13:43:40.994443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 115/226] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:40 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:41.475349 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4547ca87-5c7f-431e-9741-f6fbeafeb254 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:41.475972 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4547ca87-5c7f-431e-9741-f6fbeafeb254 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:41.483185 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4547ca87-5c7f-431e-9741-f6fbeafeb254 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:41.483606 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4547ca87-5c7f-431e-9741-f6fbeafeb254 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:41.484352 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4547ca87-5c7f-431e-9741-f6fbeafeb254 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:41.484816 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4547ca87-5c7f-431e-9741-f6fbeafeb254 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:41.618159 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4547ca87-5c7f-431e-9741-f6fbeafeb254 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:41.625555 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4547ca87-5c7f-431e-9741-f6fbeafeb254 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1314 microversion: 2.1 time: 0.156940 Jul 12 13:43:41.626152 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 112/227] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:41 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:42.011123 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9d7a3bc3-ee58-46c8-b8f7-3cc91cbe7955 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:42.011643 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9d7a3bc3-ee58-46c8-b8f7-3cc91cbe7955 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:42.018203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d7a3bc3-ee58-46c8-b8f7-3cc91cbe7955 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:42.018659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d7a3bc3-ee58-46c8-b8f7-3cc91cbe7955 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:42.019498 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d7a3bc3-ee58-46c8-b8f7-3cc91cbe7955 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:42.020063 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9d7a3bc3-ee58-46c8-b8f7-3cc91cbe7955 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:42.151365 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9d7a3bc3-ee58-46c8-b8f7-3cc91cbe7955 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:42.162529 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9d7a3bc3-ee58-46c8-b8f7-3cc91cbe7955 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.155288 Jul 12 13:43:42.163104 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 116/228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:42 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:42.643225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c73f68f1-d912-4fcd-9792-22336bb0b27b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:42.644451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c73f68f1-d912-4fcd-9792-22336bb0b27b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:42.651628 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c73f68f1-d912-4fcd-9792-22336bb0b27b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:42.652340 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c73f68f1-d912-4fcd-9792-22336bb0b27b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:42.653222 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c73f68f1-d912-4fcd-9792-22336bb0b27b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:42.653679 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c73f68f1-d912-4fcd-9792-22336bb0b27b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:42.824489 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c73f68f1-d912-4fcd-9792-22336bb0b27b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:42.836117 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c73f68f1-d912-4fcd-9792-22336bb0b27b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1314 microversion: 2.1 time: 0.196640 Jul 12 13:43:42.836734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 113/229] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:42 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:43.180150 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fd3e2355-573d-4cce-90ee-a79a104b7573 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:43.180812 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fd3e2355-573d-4cce-90ee-a79a104b7573 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:43.187374 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fd3e2355-573d-4cce-90ee-a79a104b7573 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:43.187881 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fd3e2355-573d-4cce-90ee-a79a104b7573 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:43.188607 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fd3e2355-573d-4cce-90ee-a79a104b7573 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:43.189057 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fd3e2355-573d-4cce-90ee-a79a104b7573 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:43.352461 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fd3e2355-573d-4cce-90ee-a79a104b7573 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:43.360954 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fd3e2355-573d-4cce-90ee-a79a104b7573 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.185703 Jul 12 13:43:43.361543 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 117/230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:43 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:43.853455 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-538fb9e9-7c73-4fce-9f64-2efc5be51d5d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:43.854108 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-538fb9e9-7c73-4fce-9f64-2efc5be51d5d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:43.862137 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-538fb9e9-7c73-4fce-9f64-2efc5be51d5d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:43.862850 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-538fb9e9-7c73-4fce-9f64-2efc5be51d5d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:43.864337 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-538fb9e9-7c73-4fce-9f64-2efc5be51d5d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:43.865424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-538fb9e9-7c73-4fce-9f64-2efc5be51d5d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:44.023855 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-538fb9e9-7c73-4fce-9f64-2efc5be51d5d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:44.034795 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-538fb9e9-7c73-4fce-9f64-2efc5be51d5d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1314 microversion: 2.1 time: 0.185393 Jul 12 13:43:44.036021 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 114/231] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:43 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:44.379096 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-88676268-c8cc-4549-98b1-ca7a828a5603 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:44.379715 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-88676268-c8cc-4549-98b1-ca7a828a5603 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:44.381547 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:44.387210 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88676268-c8cc-4549-98b1-ca7a828a5603 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:44.387742 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88676268-c8cc-4549-98b1-ca7a828a5603 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:44.388419 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88676268-c8cc-4549-98b1-ca7a828a5603 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:44.389151 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-88676268-c8cc-4549-98b1-ca7a828a5603 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:44.408625 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:44.529148 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-54ac72a3-64cb-4741-a4c9-0e22d8e89c20 req-6d412717-07d1-4eaa-a552-437bbff4f73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f796dc30-ede4-4ea0-8baa-6f0144831067", "name": "network-vif-plugged", "status": "completed", "tag": "aad7cbc8-64c6-4126-a418-421e2077034a"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:44.541174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-88676268-c8cc-4549-98b1-ca7a828a5603 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:44.542874 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-54ac72a3-64cb-4741-a4c9-0e22d8e89c20 req-6d412717-07d1-4eaa-a552-437bbff4f73d service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:44.543652 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-54ac72a3-64cb-4741-a4c9-0e22d8e89c20 req-6d412717-07d1-4eaa-a552-437bbff4f73d service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:44.550017 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-88676268-c8cc-4549-98b1-ca7a828a5603 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.174935 Jul 12 13:43:44.551879 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 118/232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:44 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:44.559233 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-54ac72a3-64cb-4741-a4c9-0e22d8e89c20 req-6d412717-07d1-4eaa-a552-437bbff4f73d service nova] Creating event network-vif-plugged:aad7cbc8-64c6-4126-a418-421e2077034a for instance f796dc30-ede4-4ea0-8baa-6f0144831067 on hv-cinder-79797 Jul 12 13:43:44.565132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-54ac72a3-64cb-4741-a4c9-0e22d8e89c20 req-6d412717-07d1-4eaa-a552-437bbff4f73d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043499 Jul 12 13:43:44.566076 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 115/233] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:43:45.053300 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b412c8b9-9ad8-4948-8b49-83bd7667aadb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:45.053914 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b412c8b9-9ad8-4948-8b49-83bd7667aadb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:45.060176 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b412c8b9-9ad8-4948-8b49-83bd7667aadb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:45.060632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b412c8b9-9ad8-4948-8b49-83bd7667aadb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:45.061423 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b412c8b9-9ad8-4948-8b49-83bd7667aadb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:45.061843 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b412c8b9-9ad8-4948-8b49-83bd7667aadb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:45.065834 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:45.440360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b412c8b9-9ad8-4948-8b49-83bd7667aadb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:45.448650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b412c8b9-9ad8-4948-8b49-83bd7667aadb tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1314 microversion: 2.1 time: 0.399618 Jul 12 13:43:45.449227 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 119/234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:45 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:45.564805 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=6 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:45.570628 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-060f7495-aea2-41d7-baf0-529f5acbd547 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:45.571380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-060f7495-aea2-41d7-baf0-529f5acbd547 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:45.578978 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-060f7495-aea2-41d7-baf0-529f5acbd547 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:45.579376 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-060f7495-aea2-41d7-baf0-529f5acbd547 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:45.580318 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-060f7495-aea2-41d7-baf0-529f5acbd547 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:45.580850 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-060f7495-aea2-41d7-baf0-529f5acbd547 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:45.726753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-060f7495-aea2-41d7-baf0-529f5acbd547 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:45.734502 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-060f7495-aea2-41d7-baf0-529f5acbd547 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.170907 Jul 12 13:43:45.735089 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 116/235] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:45 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:46.467366 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d27e9b90-81d0-46aa-a1db-93bab8cd81b0 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:46.468039 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d27e9b90-81d0-46aa-a1db-93bab8cd81b0 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:46.475839 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d27e9b90-81d0-46aa-a1db-93bab8cd81b0 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:46.476370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d27e9b90-81d0-46aa-a1db-93bab8cd81b0 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:46.477197 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d27e9b90-81d0-46aa-a1db-93bab8cd81b0 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:46.477698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d27e9b90-81d0-46aa-a1db-93bab8cd81b0 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:46.647183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d27e9b90-81d0-46aa-a1db-93bab8cd81b0 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:46.661614 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d27e9b90-81d0-46aa-a1db-93bab8cd81b0 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1314 microversion: 2.1 time: 0.198564 Jul 12 13:43:46.667860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 120/236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:46 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:46.752074 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-882c2bab-0d8c-4cfb-acf3-56fd7882e86f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:46.752776 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-882c2bab-0d8c-4cfb-acf3-56fd7882e86f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:46.759866 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-882c2bab-0d8c-4cfb-acf3-56fd7882e86f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:46.760394 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-882c2bab-0d8c-4cfb-acf3-56fd7882e86f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:46.761234 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-882c2bab-0d8c-4cfb-acf3-56fd7882e86f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:46.761847 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-882c2bab-0d8c-4cfb-acf3-56fd7882e86f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:46.910684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-882c2bab-0d8c-4cfb-acf3-56fd7882e86f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:46.918150 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-882c2bab-0d8c-4cfb-acf3-56fd7882e86f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.170411 Jul 12 13:43:46.918720 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 117/237] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:46 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:47.679426 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d213bfa4-cdfb-40cb-a8bd-13e2d3662293 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:47.680037 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d213bfa4-cdfb-40cb-a8bd-13e2d3662293 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:47.686309 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d213bfa4-cdfb-40cb-a8bd-13e2d3662293 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:47.686757 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d213bfa4-cdfb-40cb-a8bd-13e2d3662293 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:47.687526 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d213bfa4-cdfb-40cb-a8bd-13e2d3662293 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:47.687944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d213bfa4-cdfb-40cb-a8bd-13e2d3662293 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:47.815500 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d213bfa4-cdfb-40cb-a8bd-13e2d3662293 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:47.823070 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d213bfa4-cdfb-40cb-a8bd-13e2d3662293 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1497 microversion: 2.1 time: 0.147973 Jul 12 13:43:47.823640 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 121/238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:47 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:47.935190 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-da0ea5f7-5d21-41a8-9497-b8d7dff23acf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:47.935798 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-da0ea5f7-5d21-41a8-9497-b8d7dff23acf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:47.942218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-da0ea5f7-5d21-41a8-9497-b8d7dff23acf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:47.942671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-da0ea5f7-5d21-41a8-9497-b8d7dff23acf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:47.943433 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-da0ea5f7-5d21-41a8-9497-b8d7dff23acf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:47.943872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-da0ea5f7-5d21-41a8-9497-b8d7dff23acf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:48.071617 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-da0ea5f7-5d21-41a8-9497-b8d7dff23acf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:48.079025 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-da0ea5f7-5d21-41a8-9497-b8d7dff23acf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.147625 Jul 12 13:43:48.079592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 118/239] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:47 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:49.096279 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-71450cc7-cc4c-47c2-96b2-4db7882f7c76 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:49.096882 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-71450cc7-cc4c-47c2-96b2-4db7882f7c76 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:49.102945 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71450cc7-cc4c-47c2-96b2-4db7882f7c76 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:49.103391 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71450cc7-cc4c-47c2-96b2-4db7882f7c76 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:49.104145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71450cc7-cc4c-47c2-96b2-4db7882f7c76 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:49.104581 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71450cc7-cc4c-47c2-96b2-4db7882f7c76 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:49.232724 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-71450cc7-cc4c-47c2-96b2-4db7882f7c76 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:49.240121 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-71450cc7-cc4c-47c2-96b2-4db7882f7c76 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.147708 Jul 12 13:43:49.240683 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 122/240] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:49 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:50.247990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e6994143-1c01-43d0-8e4e-de7e152d1f58 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:50.248508 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e6994143-1c01-43d0-8e4e-de7e152d1f58 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:50.255322 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e6994143-1c01-43d0-8e4e-de7e152d1f58 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:50.255782 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e6994143-1c01-43d0-8e4e-de7e152d1f58 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:50.256551 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e6994143-1c01-43d0-8e4e-de7e152d1f58 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:50.256662 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bdf7dc28-cad2-492e-bc39-36af879d2fb9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:50.257034 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e6994143-1c01-43d0-8e4e-de7e152d1f58 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:50.257289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bdf7dc28-cad2-492e-bc39-36af879d2fb9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:50.263307 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bdf7dc28-cad2-492e-bc39-36af879d2fb9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:50.263756 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bdf7dc28-cad2-492e-bc39-36af879d2fb9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:50.264521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bdf7dc28-cad2-492e-bc39-36af879d2fb9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:50.264960 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bdf7dc28-cad2-492e-bc39-36af879d2fb9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:50.284614 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e6994143-1c01-43d0-8e4e-de7e152d1f58 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:43:50.364136 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e6994143-1c01-43d0-8e4e-de7e152d1f58 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 204 len: 0 microversion: 2.1 time: 0.119604 Jul 12 13:43:50.365021 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 119/241] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:43:50 2022] DELETE /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:43:50.374761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-68c09b84-8831-4539-8a56-9c7f331e941f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:50.375543 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-68c09b84-8831-4539-8a56-9c7f331e941f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:50.381783 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-68c09b84-8831-4539-8a56-9c7f331e941f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:50.382251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-68c09b84-8831-4539-8a56-9c7f331e941f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:50.383008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-68c09b84-8831-4539-8a56-9c7f331e941f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:50.383443 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-68c09b84-8831-4539-8a56-9c7f331e941f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:50.403758 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bdf7dc28-cad2-492e-bc39-36af879d2fb9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:50.411729 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bdf7dc28-cad2-492e-bc39-36af879d2fb9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.158925 Jul 12 13:43:50.412304 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 123/242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:50 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:50.514015 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-68c09b84-8831-4539-8a56-9c7f331e941f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:50.521869 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-68c09b84-8831-4539-8a56-9c7f331e941f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1503 microversion: 2.1 time: 0.151718 Jul 12 13:43:50.522458 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 120/243] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:50 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:51.429346 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-717adaad-d269-46a4-a829-a988c19294ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:51.429949 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-717adaad-d269-46a4-a829-a988c19294ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:51.436264 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-717adaad-d269-46a4-a829-a988c19294ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:51.436704 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-717adaad-d269-46a4-a829-a988c19294ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:51.437448 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-717adaad-d269-46a4-a829-a988c19294ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:51.437879 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-717adaad-d269-46a4-a829-a988c19294ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:51.539316 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8ff574ce-c1a0-44dc-bae3-403a4cbdcd81 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:51.539935 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8ff574ce-c1a0-44dc-bae3-403a4cbdcd81 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:51.546464 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8ff574ce-c1a0-44dc-bae3-403a4cbdcd81 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:51.546918 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8ff574ce-c1a0-44dc-bae3-403a4cbdcd81 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:51.547721 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8ff574ce-c1a0-44dc-bae3-403a4cbdcd81 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:51.548162 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8ff574ce-c1a0-44dc-bae3-403a4cbdcd81 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:51.564354 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-717adaad-d269-46a4-a829-a988c19294ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:51.571829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-717adaad-d269-46a4-a829-a988c19294ae tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.147144 Jul 12 13:43:51.572480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 124/244] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:51 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:51.674202 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8ff574ce-c1a0-44dc-bae3-403a4cbdcd81 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:51.682251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8ff574ce-c1a0-44dc-bae3-403a4cbdcd81 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1503 microversion: 2.1 time: 0.147199 Jul 12 13:43:51.682824 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 121/245] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:51 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:52.589277 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9475628e-2af7-41dd-b4ae-ba236a05f1db tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:52.589808 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9475628e-2af7-41dd-b4ae-ba236a05f1db tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:52.595919 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9475628e-2af7-41dd-b4ae-ba236a05f1db tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:52.596363 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9475628e-2af7-41dd-b4ae-ba236a05f1db tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:52.597154 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9475628e-2af7-41dd-b4ae-ba236a05f1db tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:52.597602 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9475628e-2af7-41dd-b4ae-ba236a05f1db tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:52.699105 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ae9e89da-e824-467a-881c-15be55776271 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:52.699725 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ae9e89da-e824-467a-881c-15be55776271 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:52.706219 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae9e89da-e824-467a-881c-15be55776271 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:52.706668 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae9e89da-e824-467a-881c-15be55776271 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:52.707507 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae9e89da-e824-467a-881c-15be55776271 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:52.707946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae9e89da-e824-467a-881c-15be55776271 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:52.727593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9475628e-2af7-41dd-b4ae-ba236a05f1db tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:52.735001 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9475628e-2af7-41dd-b4ae-ba236a05f1db tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.149659 Jul 12 13:43:52.735759 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 125/246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:52 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:52.838826 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ae9e89da-e824-467a-881c-15be55776271 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:52.846617 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ae9e89da-e824-467a-881c-15be55776271 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1503 microversion: 2.1 time: 0.151321 Jul 12 13:43:52.847885 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 122/247] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:52 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:53.421349 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b676abb7-26fd-4f76-9894-cde6c6b4a618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:53.421847 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b676abb7-26fd-4f76-9894-cde6c6b4a618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:53.428021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b676abb7-26fd-4f76-9894-cde6c6b4a618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:53.428473 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b676abb7-26fd-4f76-9894-cde6c6b4a618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:53.429233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b676abb7-26fd-4f76-9894-cde6c6b4a618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:53.429676 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b676abb7-26fd-4f76-9894-cde6c6b4a618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:53.451777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b676abb7-26fd-4f76-9894-cde6c6b4a618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/ips" status: 200 len: 146 microversion: 2.1 time: 0.034288 Jul 12 13:43:53.452330 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 126/248] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jul 12 13:43:53 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/ips => generated 146 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:43:53.752394 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7550d2aa-83ac-4f46-b07a-c032b80a5eb1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:53.752992 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7550d2aa-83ac-4f46-b07a-c032b80a5eb1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:53.755902 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:53.761275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7550d2aa-83ac-4f46-b07a-c032b80a5eb1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:53.761726 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7550d2aa-83ac-4f46-b07a-c032b80a5eb1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:53.762511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7550d2aa-83ac-4f46-b07a-c032b80a5eb1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:53.762939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7550d2aa-83ac-4f46-b07a-c032b80a5eb1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:53.767692 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:53.864268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d440ebd6-4d75-40af-a914-8c749b97716e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:53.864868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d440ebd6-4d75-40af-a914-8c749b97716e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:53.870966 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d440ebd6-4d75-40af-a914-8c749b97716e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:53.871497 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d440ebd6-4d75-40af-a914-8c749b97716e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:53.872279 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d440ebd6-4d75-40af-a914-8c749b97716e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:53.872718 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d440ebd6-4d75-40af-a914-8c749b97716e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:53.897212 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7550d2aa-83ac-4f46-b07a-c032b80a5eb1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:53.906409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7550d2aa-83ac-4f46-b07a-c032b80a5eb1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.158009 Jul 12 13:43:53.907285 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 123/249] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:53 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:54.014238 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d440ebd6-4d75-40af-a914-8c749b97716e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:54.022059 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d440ebd6-4d75-40af-a914-8c749b97716e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1503 microversion: 2.1 time: 0.161372 Jul 12 13:43:54.023587 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 127/250] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:53 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:54.608031 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e93869fa-443e-4233-bade-063bfa4b3c18 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:54.608856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e93869fa-443e-4233-bade-063bfa4b3c18 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:54.616012 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e93869fa-443e-4233-bade-063bfa4b3c18 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:54.616460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e93869fa-443e-4233-bade-063bfa4b3c18 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:54.617224 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e93869fa-443e-4233-bade-063bfa4b3c18 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:54.617664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e93869fa-443e-4233-bade-063bfa4b3c18 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:54.640973 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e93869fa-443e-4233-bade-063bfa4b3c18 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/ips" status: 200 len: 151 microversion: 2.20 time: 0.036833 Jul 12 13:43:54.641547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 124/251] 10.222.0.52 () {60 vars in 1288 bytes} [Tue Jul 12 13:43:54 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:43:54.926131 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e1608ccb-a8e7-4e44-b11f-b50921bb4b2c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:54.926976 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e1608ccb-a8e7-4e44-b11f-b50921bb4b2c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:54.936678 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e1608ccb-a8e7-4e44-b11f-b50921bb4b2c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:54.937122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e1608ccb-a8e7-4e44-b11f-b50921bb4b2c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:54.938263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e1608ccb-a8e7-4e44-b11f-b50921bb4b2c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:54.939141 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e1608ccb-a8e7-4e44-b11f-b50921bb4b2c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:55.002820 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-b45f0b64-45d0-4ce1-888a-d93fa15d37d1 req-78d834e7-598d-460f-85a4-64dbe5cd60a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f796dc30-ede4-4ea0-8baa-6f0144831067", "name": "network-vif-deleted", "tag": "aad7cbc8-64c6-4126-a418-421e2077034a"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:55.032859 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-b45f0b64-45d0-4ce1-888a-d93fa15d37d1 req-78d834e7-598d-460f-85a4-64dbe5cd60a6 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:55.033601 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-b45f0b64-45d0-4ce1-888a-d93fa15d37d1 req-78d834e7-598d-460f-85a4-64dbe5cd60a6 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:55.076017 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-b45f0b64-45d0-4ce1-888a-d93fa15d37d1 req-78d834e7-598d-460f-85a4-64dbe5cd60a6 service nova] Creating event network-vif-deleted:aad7cbc8-64c6-4126-a418-421e2077034a for instance f796dc30-ede4-4ea0-8baa-6f0144831067 on hv-cinder-79797 Jul 12 13:43:55.082351 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-b45f0b64-45d0-4ce1-888a-d93fa15d37d1 req-78d834e7-598d-460f-85a4-64dbe5cd60a6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087041 Jul 12 13:43:55.083502 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 125/252] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:43:55.090498 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d362aa29-2a32-40f0-9290-9ea9d8b002e3 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:55.092065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d362aa29-2a32-40f0-9290-9ea9d8b002e3 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:55.100068 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d362aa29-2a32-40f0-9290-9ea9d8b002e3 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:55.101351 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d362aa29-2a32-40f0-9290-9ea9d8b002e3 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:55.102956 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d362aa29-2a32-40f0-9290-9ea9d8b002e3 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:55.103818 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d362aa29-2a32-40f0-9290-9ea9d8b002e3 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:55.180574 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d362aa29-2a32-40f0-9290-9ea9d8b002e3 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:55.188668 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d362aa29-2a32-40f0-9290-9ea9d8b002e3 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 200 len: 1299 microversion: 2.1 time: 0.103633 Jul 12 13:43:55.188954 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e1608ccb-a8e7-4e44-b11f-b50921bb4b2c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:55.189295 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 126/253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:55 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:55.197102 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e1608ccb-a8e7-4e44-b11f-b50921bb4b2c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.274998 Jul 12 13:43:55.197538 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 128/254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:54 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:56.206316 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-749bfe31-338b-4222-84f2-4dd30ac6da6e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:56.206935 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-749bfe31-338b-4222-84f2-4dd30ac6da6e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: f796dc30-ede4-4ea0-8baa-6f0144831067] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:56.214812 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-749bfe31-338b-4222-84f2-4dd30ac6da6e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:56.215444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-749bfe31-338b-4222-84f2-4dd30ac6da6e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:56.216377 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-749bfe31-338b-4222-84f2-4dd30ac6da6e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:56.216729 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-855d0ce6-1696-4969-8304-c406a414a333 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:56.217660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-855d0ce6-1696-4969-8304-c406a414a333 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:56.218990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-749bfe31-338b-4222-84f2-4dd30ac6da6e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:56.228958 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-855d0ce6-1696-4969-8304-c406a414a333 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:56.230956 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-855d0ce6-1696-4969-8304-c406a414a333 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:56.233201 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-855d0ce6-1696-4969-8304-c406a414a333 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:56.235020 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-855d0ce6-1696-4969-8304-c406a414a333 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:56.246696 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-749bfe31-338b-4222-84f2-4dd30ac6da6e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] HTTP exception thrown: Instance f796dc30-ede4-4ea0-8baa-6f0144831067 could not be found. Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-749bfe31-338b-4222-84f2-4dd30ac6da6e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Request method failure captured: Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 HTTP/1.1 Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXqD4uW_BoEEVHDM0cg-fWozYoFKIMQPbu4mvCm1Y4o-KWYIcTWFWbpU6h-lyiXxEMJ1vwb7yMSiUePALkYW9lYv4HfOkg_1cj--UmNslhax5LpMtLug8RDi1REFYSGt4y0pZ2LiElZLy4Cnbr4RxBLO-f9QNGa2cm_TSjLdHjk1jwI Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 4f3ab1e8d5fd4ac7b34c60a4a3cf9c45 Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-VolumesActionsTest-390629507 Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:43:56.249191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f3ab1e8d5fd4ac7b34c60a4a3cf9c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f3ab1e8d5fd4ac7b34c60a4a3cf9c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f3ab1e8d5fd4ac7b34c60a4a3cf9c45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f3ab1e8d5fd4ac7b34c60a4a3cf9c45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-VolumesActionsTest-390629507 Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 4f3ab1e8d5fd4ac7b34c60a4a3cf9c45 Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-VolumesActionsTest-390629507 Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-VolumesActionsTest-390629507-project Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 287144c6346a43d09cdbae463ca9a961 Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-VolumesActionsTest-390629507-project Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance f796dc30-ede4-4ea0-8baa-6f0144831067 could not be found. Jul 12 13:43:56.250746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'f796dc30-ede4-4ea0-8baa-6f0144831067'} Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f796dc30-ede4-4ea0-8baa-6f0144831067 could not be found. Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:43:56.252083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f796dc30-ede4-4ea0-8baa-6f0144831067 could not be found. Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f796dc30-ede4-4ea0-8baa-6f0144831067 could not be found. Jul 12 13:43:56.253592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:43:56.257073 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-749bfe31-338b-4222-84f2-4dd30ac6da6e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Returning 404 to user: Instance f796dc30-ede4-4ea0-8baa-6f0144831067 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:43:56.258786 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-749bfe31-338b-4222-84f2-4dd30ac6da6e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067" status: 404 len: 111 microversion: 2.1 time: 0.056441 Jul 12 13:43:56.263245 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 127/255] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:56 2022] GET /compute/v2.1/servers/f796dc30-ede4-4ea0-8baa-6f0144831067 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:43:56.431204 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-353932226", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "networks": [{"uuid": "626c6cea-7728-4107-9956-7f258a8aef06"}]}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:56.474955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-855d0ce6-1696-4969-8304-c406a414a333 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:56.484641 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-855d0ce6-1696-4969-8304-c406a414a333 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.272161 Jul 12 13:43:56.493989 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 129/256] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:56 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:56.494951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.network.neutron [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] validate_networks() for [('626c6cea-7728-4107-9956-7f258a8aef06', None, None, None, None, None)] {{(pid=124465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:43:56.920983 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Flavor limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:43:56.921611 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Image limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:43:56.922118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Flavor pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:43:56.922781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Image pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:43:56.922937 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:43:56.932696 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:56.933154 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:56.934052 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:56.934429 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:56.953396 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Getting quotas for project 4f3ab1e8d5fd4ac7b34c60a4a3cf9c45. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:43:56.963050 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Getting quotas for user 287144c6346a43d09cdbae463ca9a961 and project 4f3ab1e8d5fd4ac7b34c60a4a3cf9c45. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:43:56.976603 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Going to run 1 instances... {{(pid=124465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:43:56.979599 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:43:57.029843 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d270540a-3ce4-4f45-a1da-ce3f1f882bc8 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602445 Jul 12 13:43:57.030607 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 128/257] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:43:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 13:43:57.041972 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f241fa28-3dc4-4003-bbc4-3516e6c98acf tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:57.042718 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f241fa28-3dc4-4003-bbc4-3516e6c98acf tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:57.058510 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f86f7de3-d929-4e5b-b6f0-20a98f6f03c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e7a7297-4274-4888-a918-7cdd234b8e01"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:57.059834 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f86f7de3-d929-4e5b-b6f0-20a98f6f03c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:57.066521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f86f7de3-d929-4e5b-b6f0-20a98f6f03c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:57.067712 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f86f7de3-d929-4e5b-b6f0-20a98f6f03c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:57.068650 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f86f7de3-d929-4e5b-b6f0-20a98f6f03c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:57.069088 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f86f7de3-d929-4e5b-b6f0-20a98f6f03c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:57.116849 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f241fa28-3dc4-4003-bbc4-3516e6c98acf tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:57.123629 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f241fa28-3dc4-4003-bbc4-3516e6c98acf tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1213 microversion: 2.1 time: 0.086096 Jul 12 13:43:57.124449 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 130/258] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:57 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:57.507673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1f9abec4-9dbe-4d5c-b4d9-475af6c21855 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:57.508452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1f9abec4-9dbe-4d5c-b4d9-475af6c21855 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:57.514676 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1f9abec4-9dbe-4d5c-b4d9-475af6c21855 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:57.515411 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1f9abec4-9dbe-4d5c-b4d9-475af6c21855 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:57.516298 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1f9abec4-9dbe-4d5c-b4d9-475af6c21855 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:57.516833 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1f9abec4-9dbe-4d5c-b4d9-475af6c21855 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:57.625725 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f86f7de3-d929-4e5b-b6f0-20a98f6f03c4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.570717 Jul 12 13:43:57.627121 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 129/259] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:43:57 2022] POST /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/os-volume_attachments => generated 194 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:43:57.688449 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1f9abec4-9dbe-4d5c-b4d9-475af6c21855 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:57.697239 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1f9abec4-9dbe-4d5c-b4d9-475af6c21855 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.194110 Jul 12 13:43:57.698523 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 131/260] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:57 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:43:58.141816 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ba084800-b384-4cff-814e-1521f41f56f2 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:58.142556 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ba084800-b384-4cff-814e-1521f41f56f2 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:58.148975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ba084800-b384-4cff-814e-1521f41f56f2 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:58.149298 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ba084800-b384-4cff-814e-1521f41f56f2 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:58.150088 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ba084800-b384-4cff-814e-1521f41f56f2 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:58.150523 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ba084800-b384-4cff-814e-1521f41f56f2 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:58.218054 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ba084800-b384-4cff-814e-1521f41f56f2 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:58.226822 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ba084800-b384-4cff-814e-1521f41f56f2 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1265 microversion: 2.1 time: 0.089844 Jul 12 13:43:58.227732 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 130/261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:58 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:58.715135 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b6de471b-0a07-419b-84f6-72b9e2c0a561 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:58.716125 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b6de471b-0a07-419b-84f6-72b9e2c0a561 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:58.719321 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:58.727830 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b6de471b-0a07-419b-84f6-72b9e2c0a561 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:58.729286 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b6de471b-0a07-419b-84f6-72b9e2c0a561 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:58.731199 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b6de471b-0a07-419b-84f6-72b9e2c0a561 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:58.731855 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b6de471b-0a07-419b-84f6-72b9e2c0a561 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:58.918831 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b6de471b-0a07-419b-84f6-72b9e2c0a561 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:58.926507 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b6de471b-0a07-419b-84f6-72b9e2c0a561 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.215330 Jul 12 13:43:58.927168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 132/262] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:58 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:59.244367 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7e5f65eb-4aed-4445-8cf1-4baa3e7d5610 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:59.244990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7e5f65eb-4aed-4445-8cf1-4baa3e7d5610 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:59.251488 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e5f65eb-4aed-4445-8cf1-4baa3e7d5610 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:59.252200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e5f65eb-4aed-4445-8cf1-4baa3e7d5610 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:59.252951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e5f65eb-4aed-4445-8cf1-4baa3e7d5610 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:59.253389 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e5f65eb-4aed-4445-8cf1-4baa3e7d5610 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:59.389426 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7e5f65eb-4aed-4445-8cf1-4baa3e7d5610 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:43:59.396851 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7e5f65eb-4aed-4445-8cf1-4baa3e7d5610 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.156386 Jul 12 13:43:59.397422 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 131/263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:59 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:43:59.834448 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c4e55151-52f3-4186-93ac-b5609e3a278d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:43:59.835014 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c4e55151-52f3-4186-93ac-b5609e3a278d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:59.841009 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4e55151-52f3-4186-93ac-b5609e3a278d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:59.841463 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4e55151-52f3-4186-93ac-b5609e3a278d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:59.842255 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4e55151-52f3-4186-93ac-b5609e3a278d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:59.842695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c4e55151-52f3-4186-93ac-b5609e3a278d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:59.867049 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-c4e55151-52f3-4186-93ac-b5609e3a278d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lazy-loading 'flavor' on Instance uuid e71d01af-d429-48d6-9f16-6255557bdb67 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:43:59.943096 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-09afee71-2484-44a6-9454-efbaf8c60118 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:43:59.943726 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-09afee71-2484-44a6-9454-efbaf8c60118 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:43:59.950119 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09afee71-2484-44a6-9454-efbaf8c60118 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:59.950566 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09afee71-2484-44a6-9454-efbaf8c60118 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:43:59.951319 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09afee71-2484-44a6-9454-efbaf8c60118 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:43:59.951751 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09afee71-2484-44a6-9454-efbaf8c60118 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:00.090711 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-09afee71-2484-44a6-9454-efbaf8c60118 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:00.099280 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-09afee71-2484-44a6-9454-efbaf8c60118 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.160024 Jul 12 13:44:00.099846 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 132/264] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:43:59 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:00.189360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c4e55151-52f3-4186-93ac-b5609e3a278d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "POST /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/action" status: 202 len: 0 microversion: 2.20 time: 0.358709 Jul 12 13:44:00.190652 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 133/265] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jul 12 13:43:59 2022] POST /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:44:00.198601 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-71b98aba-2c0f-474e-8a82-60d87b362455 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:00.199240 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-71b98aba-2c0f-474e-8a82-60d87b362455 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:00.205333 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-71b98aba-2c0f-474e-8a82-60d87b362455 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:00.205784 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-71b98aba-2c0f-474e-8a82-60d87b362455 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:00.206568 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-71b98aba-2c0f-474e-8a82-60d87b362455 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:00.207002 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-71b98aba-2c0f-474e-8a82-60d87b362455 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:00.336710 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-71b98aba-2c0f-474e-8a82-60d87b362455 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:00.344736 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-71b98aba-2c0f-474e-8a82-60d87b362455 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:00.346288 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-71b98aba-2c0f-474e-8a82-60d87b362455 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:00.347451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-71b98aba-2c0f-474e-8a82-60d87b362455 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.152734 Jul 12 13:44:00.348002 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 133/266] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:00 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:00.414624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7f35399f-673e-4658-b393-9024b9b9869b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:00.415352 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7f35399f-673e-4658-b393-9024b9b9869b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:00.421769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7f35399f-673e-4658-b393-9024b9b9869b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:00.422470 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7f35399f-673e-4658-b393-9024b9b9869b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:00.423418 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7f35399f-673e-4658-b393-9024b9b9869b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:00.423864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7f35399f-673e-4658-b393-9024b9b9869b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:00.561207 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7f35399f-673e-4658-b393-9024b9b9869b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:00.570057 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7f35399f-673e-4658-b393-9024b9b9869b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.159698 Jul 12 13:44:00.570638 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 134/267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:00 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:01.117109 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8d418b5f-722f-40c6-a1a8-ea7b7d058f5a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:01.117747 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8d418b5f-722f-40c6-a1a8-ea7b7d058f5a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:01.124237 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8d418b5f-722f-40c6-a1a8-ea7b7d058f5a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:01.124689 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8d418b5f-722f-40c6-a1a8-ea7b7d058f5a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:01.125450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8d418b5f-722f-40c6-a1a8-ea7b7d058f5a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:01.125884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8d418b5f-722f-40c6-a1a8-ea7b7d058f5a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:01.256329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8d418b5f-722f-40c6-a1a8-ea7b7d058f5a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:01.263768 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8d418b5f-722f-40c6-a1a8-ea7b7d058f5a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.151165 Jul 12 13:44:01.264334 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 134/268] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:01 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:01.366700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b4e37a16-e260-4eb1-9f44-7495d513f141 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:01.367337 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b4e37a16-e260-4eb1-9f44-7495d513f141 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:01.374309 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b4e37a16-e260-4eb1-9f44-7495d513f141 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:01.374784 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b4e37a16-e260-4eb1-9f44-7495d513f141 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:01.375717 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b4e37a16-e260-4eb1-9f44-7495d513f141 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:01.376236 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b4e37a16-e260-4eb1-9f44-7495d513f141 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:01.406128 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:01.589141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-be83fed9-f628-47a3-be6b-c69ef53b64a4 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:01.590010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-be83fed9-f628-47a3-be6b-c69ef53b64a4 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:01.596064 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be83fed9-f628-47a3-be6b-c69ef53b64a4 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:01.596586 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be83fed9-f628-47a3-be6b-c69ef53b64a4 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:01.597436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be83fed9-f628-47a3-be6b-c69ef53b64a4 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:01.597875 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be83fed9-f628-47a3-be6b-c69ef53b64a4 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:01.614817 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b4e37a16-e260-4eb1-9f44-7495d513f141 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:01.625247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b4e37a16-e260-4eb1-9f44-7495d513f141 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:01.627230 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b4e37a16-e260-4eb1-9f44-7495d513f141 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:01.628591 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b4e37a16-e260-4eb1-9f44-7495d513f141 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.266456 Jul 12 13:44:01.629265 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 135/269] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:01 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:01.730868 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-be83fed9-f628-47a3-be6b-c69ef53b64a4 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:01.738460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-be83fed9-f628-47a3-be6b-c69ef53b64a4 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.154264 Jul 12 13:44:01.739034 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 135/270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:01 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:02.027864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-5e9c5527-ba16-46b8-a1db-3ca7f25bac2f req-d0d53d35-abb2-4e1b-b477-df1e3acbdfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc4f645-5c2b-4346-b730-0dff41046431", "tag": "f5c34854-96a1-481a-80a7-dd3a6412961b"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:02.031418 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-5e9c5527-ba16-46b8-a1db-3ca7f25bac2f req-d0d53d35-abb2-4e1b-b477-df1e3acbdfe5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:02.031886 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-5e9c5527-ba16-46b8-a1db-3ca7f25bac2f req-d0d53d35-abb2-4e1b-b477-df1e3acbdfe5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:02.043092 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-5e9c5527-ba16-46b8-a1db-3ca7f25bac2f req-d0d53d35-abb2-4e1b-b477-df1e3acbdfe5 service nova] Creating event network-changed:f5c34854-96a1-481a-80a7-dd3a6412961b for instance 6dc4f645-5c2b-4346-b730-0dff41046431 on hv-cinder-79797 Jul 12 13:44:02.047564 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-5e9c5527-ba16-46b8-a1db-3ca7f25bac2f req-d0d53d35-abb2-4e1b-b477-df1e3acbdfe5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030604 Jul 12 13:44:02.048135 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 136/271] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:02.282331 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c2ab741a-2511-46f9-a2fb-5cf76ef5ea17 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:02.283054 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c2ab741a-2511-46f9-a2fb-5cf76ef5ea17 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:02.289719 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2ab741a-2511-46f9-a2fb-5cf76ef5ea17 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:02.290293 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2ab741a-2511-46f9-a2fb-5cf76ef5ea17 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:02.291137 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2ab741a-2511-46f9-a2fb-5cf76ef5ea17 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:02.291578 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2ab741a-2511-46f9-a2fb-5cf76ef5ea17 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:02.634500 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-56547590", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2014345130", "security_groups": [{"name": "tempest-secgroup-smoke-538548261"}], "block_device_mapping_v2": [{"uuid": "9cbae3dc-eba3-44a2-8800-3e658dc6cea8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3509328d-f94d-4eb3-96d7-561308f3a4f7"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:02.687006 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c2ab741a-2511-46f9-a2fb-5cf76ef5ea17 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:02.694818 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c2ab741a-2511-46f9-a2fb-5cf76ef5ea17 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.416289 Jul 12 13:44:02.703981 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 136/272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:02 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:02.708993 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-419eb86e-f826-4d1d-ab64-dc59b0822e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:02.709596 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-419eb86e-f826-4d1d-ab64-dc59b0822e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:02.715778 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-419eb86e-f826-4d1d-ab64-dc59b0822e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:02.716224 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-419eb86e-f826-4d1d-ab64-dc59b0822e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:02.716981 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-419eb86e-f826-4d1d-ab64-dc59b0822e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:02.717414 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-419eb86e-f826-4d1d-ab64-dc59b0822e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:02.753160 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] validate_networks() for [('3509328d-f94d-4eb3-96d7-561308f3a4f7', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:44:02.859312 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-419eb86e-f826-4d1d-ab64-dc59b0822e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:02.868026 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-419eb86e-f826-4d1d-ab64-dc59b0822e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:02.869608 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-419eb86e-f826-4d1d-ab64-dc59b0822e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:02.871098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-419eb86e-f826-4d1d-ab64-dc59b0822e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.165954 Jul 12 13:44:02.871807 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 137/273] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:02 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:02.877225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3796c749-aa19-40a0-9656-af3aa6062a1e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:02.877824 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3796c749-aa19-40a0-9656-af3aa6062a1e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:02.884613 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3796c749-aa19-40a0-9656-af3aa6062a1e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:02.885070 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3796c749-aa19-40a0-9656-af3aa6062a1e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:02.885838 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3796c749-aa19-40a0-9656-af3aa6062a1e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:02.886319 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3796c749-aa19-40a0-9656-af3aa6062a1e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:03.102045 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3796c749-aa19-40a0-9656-af3aa6062a1e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:03.110365 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3796c749-aa19-40a0-9656-af3aa6062a1e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.237288 Jul 12 13:44:03.111082 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 138/274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:02 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:03.664113 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:44:03.677672 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:44:03.678243 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:44:03.678660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:44:03.679116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:44:03.688987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:03.689458 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:03.690695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:03.691134 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:03.710651 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Getting quotas for project edae8cd268da40a3b8e2affe277bc56e. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:44:03.712602 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-18ef921a-9bd6-42fa-b53f-8349f0b2500b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:03.713710 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-18ef921a-9bd6-42fa-b53f-8349f0b2500b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:03.720686 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-18ef921a-9bd6-42fa-b53f-8349f0b2500b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:03.721337 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-18ef921a-9bd6-42fa-b53f-8349f0b2500b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:03.722372 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-18ef921a-9bd6-42fa-b53f-8349f0b2500b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:03.722964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-18ef921a-9bd6-42fa-b53f-8349f0b2500b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:03.725779 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Getting quotas for user bb11db914a57439bada24b5f755a143a and project edae8cd268da40a3b8e2affe277bc56e. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:44:03.788525 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:44:03.791097 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9cbae3dc-eba3-44a2-8800-3e658dc6cea8',volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:44:03.880785 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-18ef921a-9bd6-42fa-b53f-8349f0b2500b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:03.889003 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-18ef921a-9bd6-42fa-b53f-8349f0b2500b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.180518 Jul 12 13:44:03.889585 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 139/275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:03 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:03.894034 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d12364e1-6f13-4bf5-90c9-8157794c06d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:03.894795 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d12364e1-6f13-4bf5-90c9-8157794c06d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:03.900998 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d12364e1-6f13-4bf5-90c9-8157794c06d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:03.901669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d12364e1-6f13-4bf5-90c9-8157794c06d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:03.902466 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d12364e1-6f13-4bf5-90c9-8157794c06d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:03.902901 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d12364e1-6f13-4bf5-90c9-8157794c06d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:03.948944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1c6245f8-78f2-4c10-9967-6ac4adc5b62a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.318655 Jul 12 13:44:03.950464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 137/276] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:44:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 13:44:03.975761 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2c46c5d0-21f4-469e-9e90-96ef5f3ecaab tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:03.976418 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2c46c5d0-21f4-469e-9e90-96ef5f3ecaab tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:04.085546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2c46c5d0-21f4-469e-9e90-96ef5f3ecaab tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:04.102759 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2c46c5d0-21f4-469e-9e90-96ef5f3ecaab tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1093 microversion: 2.1 time: 0.137099 Jul 12 13:44:04.103987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 138/277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:03 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1093 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:04.116975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d12364e1-6f13-4bf5-90c9-8157794c06d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:04.119593 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:04.128857 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d12364e1-6f13-4bf5-90c9-8157794c06d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:04.129922 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-17936523-f4d9-4933-800a-0fb811433a5b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:04.130683 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-17936523-f4d9-4933-800a-0fb811433a5b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:04.131027 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d12364e1-6f13-4bf5-90c9-8157794c06d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:04.132379 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d12364e1-6f13-4bf5-90c9-8157794c06d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.241855 Jul 12 13:44:04.133274 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 140/278] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:03 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:04.140087 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17936523-f4d9-4933-800a-0fb811433a5b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:04.141311 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17936523-f4d9-4933-800a-0fb811433a5b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:04.143122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17936523-f4d9-4933-800a-0fb811433a5b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:04.143673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17936523-f4d9-4933-800a-0fb811433a5b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:04.319574 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-17936523-f4d9-4933-800a-0fb811433a5b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:04.327453 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-17936523-f4d9-4933-800a-0fb811433a5b tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.202878 Jul 12 13:44:04.328081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 139/279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:04 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:04.906883 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4eeb41f8-7d44-4023-98cb-05f4a66e7101 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:04.907528 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4eeb41f8-7d44-4023-98cb-05f4a66e7101 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:04.915212 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4eeb41f8-7d44-4023-98cb-05f4a66e7101 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:04.915667 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4eeb41f8-7d44-4023-98cb-05f4a66e7101 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:04.916467 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4eeb41f8-7d44-4023-98cb-05f4a66e7101 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:04.916908 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4eeb41f8-7d44-4023-98cb-05f4a66e7101 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.069298 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4eeb41f8-7d44-4023-98cb-05f4a66e7101 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:05.078680 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4eeb41f8-7d44-4023-98cb-05f4a66e7101 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1503 microversion: 2.1 time: 0.176383 Jul 12 13:44:05.079268 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 141/280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:04 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:05.096482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9afe2a3f-4039-47e1-ade9-a0cbc03109d4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c72ddf9b-fdc9-457d-8ad4-1ffbd2761452"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:05.097821 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9afe2a3f-4039-47e1-ade9-a0cbc03109d4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:05.111431 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9afe2a3f-4039-47e1-ade9-a0cbc03109d4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.112278 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9afe2a3f-4039-47e1-ade9-a0cbc03109d4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.113515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9afe2a3f-4039-47e1-ade9-a0cbc03109d4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.113983 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9afe2a3f-4039-47e1-ade9-a0cbc03109d4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.120664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3cdb48be-b96c-4043-8dbb-cfb177876d09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:05.121664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3cdb48be-b96c-4043-8dbb-cfb177876d09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:05.128909 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3cdb48be-b96c-4043-8dbb-cfb177876d09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.129819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3cdb48be-b96c-4043-8dbb-cfb177876d09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.131201 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3cdb48be-b96c-4043-8dbb-cfb177876d09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.131706 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3cdb48be-b96c-4043-8dbb-cfb177876d09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.145952 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-9afe2a3f-4039-47e1-ade9-a0cbc03109d4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] HTTP exception thrown: Cannot 'attach_volume' instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 while it is in vm_state rescued Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9afe2a3f-4039-47e1-ade9-a0cbc03109d4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Request method failure captured: Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: POST /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33/os-volume_attachments HTTP/1.1 Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 74 Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXorjIDAbtDtJtOvfy_yv9nBXh4UfqRhYUnfhCPKZ1w7W9kDGIwjj1ekTdMPn8zN7wGJMTx5Sr-aikVIUV7yloW36HiYAaoGvrQUKUEGS8UYjts_zznUym4pBD6f0O81kujlfPaGrVaLWq2QpCY88duImZRzAd5rjBlsG-Ag3b_ZjJI Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 026f214eb4ee4a9c807b928710c93db5 Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:44:05.148187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 026f214eb4ee4a9c807b928710c93db5 Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-ServerRescueNegativeTestJSON-544559158-project Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: 4a6b3bd40ad744908a05df7410cace52 Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-ServerRescueNegativeTestJSON-544559158-project Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {"volumeAttachment": {"volumeId": "c72ddf9b-fdc9-457d-8ad4-1ffbd2761452"}} Jul 12 13:44:05.149666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Cannot 'attach_volume' instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 while it is in vm_state rescued Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'server_id': '4bb10a9b-adfe-4578-82cc-c87fb34cbc33', 'body': {'volumeAttachment': {'volumeId': 'c72ddf9b-fdc9-457d-8ad4-1ffbd2761452'}}} Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:44:05.150681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 while it is in vm_state rescued Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:44:05.151744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:44:05.153149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:44:05.153149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:44:05.153149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 while it is in vm_state rescued Jul 12 13:44:05.153149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:44:05.154626 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9afe2a3f-4039-47e1-ade9-a0cbc03109d4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Returning 409 to user: Cannot 'attach_volume' instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 while it is in vm_state rescued {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:44:05.155711 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9afe2a3f-4039-47e1-ade9-a0cbc03109d4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063437 Jul 12 13:44:05.157071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 140/281] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:44:05 2022] POST /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 13:44:05.166459 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-487c4c6f-2488-47fa-ae8f-a9bc94d6a910 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:05.167306 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-487c4c6f-2488-47fa-ae8f-a9bc94d6a910 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:05.175290 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-487c4c6f-2488-47fa-ae8f-a9bc94d6a910 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.176096 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-487c4c6f-2488-47fa-ae8f-a9bc94d6a910 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.177896 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-487c4c6f-2488-47fa-ae8f-a9bc94d6a910 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.178585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-487c4c6f-2488-47fa-ae8f-a9bc94d6a910 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.248555 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3cdb48be-b96c-4043-8dbb-cfb177876d09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:05.258509 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3cdb48be-b96c-4043-8dbb-cfb177876d09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1135 microversion: 2.1 time: 0.141778 Jul 12 13:44:05.259003 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 142/282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:05 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1135 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:05.267279 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-77d6df5f-e416-4029-bfec-15eb2312bc13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:05.267279 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-77d6df5f-e416-4029-bfec-15eb2312bc13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:05.272279 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-77d6df5f-e416-4029-bfec-15eb2312bc13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.272967 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-77d6df5f-e416-4029-bfec-15eb2312bc13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.273741 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-77d6df5f-e416-4029-bfec-15eb2312bc13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.274208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-77d6df5f-e416-4029-bfec-15eb2312bc13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.350149 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-77d6df5f-e416-4029-bfec-15eb2312bc13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33/action" status: 202 len: 0 microversion: 2.1 time: 0.089855 Jul 12 13:44:05.350786 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 143/283] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:44:05 2022] POST /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:44:05.356036 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4eb2a47f-f93b-4cd3-9361-bdb06705f3e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:05.356743 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4eb2a47f-f93b-4cd3-9361-bdb06705f3e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:05.363526 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4eb2a47f-f93b-4cd3-9361-bdb06705f3e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.364788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4eb2a47f-f93b-4cd3-9361-bdb06705f3e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.366467 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4eb2a47f-f93b-4cd3-9361-bdb06705f3e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.366467 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4eb2a47f-f93b-4cd3-9361-bdb06705f3e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.388830 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-487c4c6f-2488-47fa-ae8f-a9bc94d6a910 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:05.396828 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-487c4c6f-2488-47fa-ae8f-a9bc94d6a910 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:05.398367 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-487c4c6f-2488-47fa-ae8f-a9bc94d6a910 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:05.399517 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-487c4c6f-2488-47fa-ae8f-a9bc94d6a910 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.241370 Jul 12 13:44:05.400071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 141/284] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:05 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:05.404519 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-767d16fc-4a7d-4352-8f63-06a715242c7d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:05.405117 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-767d16fc-4a7d-4352-8f63-06a715242c7d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:05.411762 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-767d16fc-4a7d-4352-8f63-06a715242c7d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.412220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-767d16fc-4a7d-4352-8f63-06a715242c7d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.412979 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-767d16fc-4a7d-4352-8f63-06a715242c7d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:05.413415 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-767d16fc-4a7d-4352-8f63-06a715242c7d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:05.511430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4eb2a47f-f93b-4cd3-9361-bdb06705f3e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:05.518898 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4eb2a47f-f93b-4cd3-9361-bdb06705f3e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.166842 Jul 12 13:44:05.519587 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 144/285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:05 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:05.545405 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-767d16fc-4a7d-4352-8f63-06a715242c7d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:05.553327 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-767d16fc-4a7d-4352-8f63-06a715242c7d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1511 microversion: 2.1 time: 0.152323 Jul 12 13:44:05.553897 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 142/286] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:05 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:06.276825 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d1645527-ad09-4b4c-b552-3175ab87c77f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:06.277587 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d1645527-ad09-4b4c-b552-3175ab87c77f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:06.284349 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1645527-ad09-4b4c-b552-3175ab87c77f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:06.284928 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1645527-ad09-4b4c-b552-3175ab87c77f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:06.285739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1645527-ad09-4b4c-b552-3175ab87c77f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:06.286221 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1645527-ad09-4b4c-b552-3175ab87c77f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:06.347534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d1645527-ad09-4b4c-b552-3175ab87c77f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:06.355588 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d1645527-ad09-4b4c-b552-3175ab87c77f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1199 microversion: 2.1 time: 0.082904 Jul 12 13:44:06.356182 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 145/287] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:06 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:06.417787 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aa6f60a7-412c-4a29-a137-c3bd762ba551 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:06.418407 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aa6f60a7-412c-4a29-a137-c3bd762ba551 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:06.424532 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa6f60a7-412c-4a29-a137-c3bd762ba551 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:06.424977 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa6f60a7-412c-4a29-a137-c3bd762ba551 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:06.425768 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa6f60a7-412c-4a29-a137-c3bd762ba551 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:06.426204 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa6f60a7-412c-4a29-a137-c3bd762ba551 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:06.542081 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-698abdcf-8aba-4bd8-929b-2971d886273f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:06.545535 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-698abdcf-8aba-4bd8-929b-2971d886273f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:06.560030 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-698abdcf-8aba-4bd8-929b-2971d886273f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:06.563047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-698abdcf-8aba-4bd8-929b-2971d886273f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:06.564146 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-698abdcf-8aba-4bd8-929b-2971d886273f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:06.564780 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-698abdcf-8aba-4bd8-929b-2971d886273f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:06.708750 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa6f60a7-412c-4a29-a137-c3bd762ba551 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:06.717168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa6f60a7-412c-4a29-a137-c3bd762ba551 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:06.718723 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa6f60a7-412c-4a29-a137-c3bd762ba551 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:06.719877 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aa6f60a7-412c-4a29-a137-c3bd762ba551 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.305944 Jul 12 13:44:06.729832 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 143/288] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:06 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:06.729832 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5a2f6957-2f8a-48a6-b75c-af48e344e5b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:06.729832 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5a2f6957-2f8a-48a6-b75c-af48e344e5b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:06.732684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a2f6957-2f8a-48a6-b75c-af48e344e5b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:06.733385 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a2f6957-2f8a-48a6-b75c-af48e344e5b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:06.745468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a2f6957-2f8a-48a6-b75c-af48e344e5b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:06.746391 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5a2f6957-2f8a-48a6-b75c-af48e344e5b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:06.826884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-698abdcf-8aba-4bd8-929b-2971d886273f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:06.872362 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-698abdcf-8aba-4bd8-929b-2971d886273f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.337983 Jul 12 13:44:06.884796 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 146/289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:06 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:07.055386 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5a2f6957-2f8a-48a6-b75c-af48e344e5b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:07.071463 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5a2f6957-2f8a-48a6-b75c-af48e344e5b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1511 microversion: 2.1 time: 0.346276 Jul 12 13:44:07.071932 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 144/290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:06 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:07.374753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-02c28077-99f8-4fd7-85b9-c4e242695141 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:07.375383 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-02c28077-99f8-4fd7-85b9-c4e242695141 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:07.377870 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:07.378673 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=6 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:07.389149 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02c28077-99f8-4fd7-85b9-c4e242695141 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:07.389608 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02c28077-99f8-4fd7-85b9-c4e242695141 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:07.390407 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02c28077-99f8-4fd7-85b9-c4e242695141 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:07.391375 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02c28077-99f8-4fd7-85b9-c4e242695141 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:07.495990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-02c28077-99f8-4fd7-85b9-c4e242695141 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:07.504638 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-02c28077-99f8-4fd7-85b9-c4e242695141 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1209 microversion: 2.1 time: 0.135288 Jul 12 13:44:07.505850 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 147/291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:07 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1209 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:07.737720 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-506cc3e0-f4a6-43d3-b3fd-30c0b2e1ff1f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:07.738999 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-506cc3e0-f4a6-43d3-b3fd-30c0b2e1ff1f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:07.746387 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-506cc3e0-f4a6-43d3-b3fd-30c0b2e1ff1f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:07.746858 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-506cc3e0-f4a6-43d3-b3fd-30c0b2e1ff1f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:07.747643 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-506cc3e0-f4a6-43d3-b3fd-30c0b2e1ff1f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:07.748495 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-506cc3e0-f4a6-43d3-b3fd-30c0b2e1ff1f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:07.897425 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-506cc3e0-f4a6-43d3-b3fd-30c0b2e1ff1f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:07.900005 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e5e5f1c4-da66-4be9-979c-bafbcd39c96e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:07.900734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e5e5f1c4-da66-4be9-979c-bafbcd39c96e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:07.906578 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-506cc3e0-f4a6-43d3-b3fd-30c0b2e1ff1f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:07.906848 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e5e5f1c4-da66-4be9-979c-bafbcd39c96e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:07.907362 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e5e5f1c4-da66-4be9-979c-bafbcd39c96e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:07.908155 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-506cc3e0-f4a6-43d3-b3fd-30c0b2e1ff1f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:07.908888 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e5e5f1c4-da66-4be9-979c-bafbcd39c96e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:07.909315 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-506cc3e0-f4a6-43d3-b3fd-30c0b2e1ff1f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.175566 Jul 12 13:44:07.909419 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e5e5f1c4-da66-4be9-979c-bafbcd39c96e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:07.909865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 145/292] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:07 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:08.043138 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e5e5f1c4-da66-4be9-979c-bafbcd39c96e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:08.050587 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e5e5f1c4-da66-4be9-979c-bafbcd39c96e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.160348 Jul 12 13:44:08.051354 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 148/293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:07 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:08.092588 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f842e1b6-cc7f-43d9-a4aa-2a091fab4dd1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:08.093185 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f842e1b6-cc7f-43d9-a4aa-2a091fab4dd1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:08.099360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f842e1b6-cc7f-43d9-a4aa-2a091fab4dd1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:08.099809 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f842e1b6-cc7f-43d9-a4aa-2a091fab4dd1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:08.100621 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f842e1b6-cc7f-43d9-a4aa-2a091fab4dd1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:08.101055 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f842e1b6-cc7f-43d9-a4aa-2a091fab4dd1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:08.232953 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f842e1b6-cc7f-43d9-a4aa-2a091fab4dd1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:08.240803 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f842e1b6-cc7f-43d9-a4aa-2a091fab4dd1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1511 microversion: 2.1 time: 0.152115 Jul 12 13:44:08.241359 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 146/294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:08 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:08.522251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6c7d1d7b-a01c-4e38-98d0-0e46a62f63b9 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:08.522862 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6c7d1d7b-a01c-4e38-98d0-0e46a62f63b9 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:08.529323 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6c7d1d7b-a01c-4e38-98d0-0e46a62f63b9 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:08.529718 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6c7d1d7b-a01c-4e38-98d0-0e46a62f63b9 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:08.530522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6c7d1d7b-a01c-4e38-98d0-0e46a62f63b9 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:08.530967 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6c7d1d7b-a01c-4e38-98d0-0e46a62f63b9 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:08.666099 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6c7d1d7b-a01c-4e38-98d0-0e46a62f63b9 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:08.673742 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6c7d1d7b-a01c-4e38-98d0-0e46a62f63b9 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1276 microversion: 2.1 time: 0.155372 Jul 12 13:44:08.674346 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 149/295] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:08 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:08.927402 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-77b5b24a-fbfa-44f3-a6a1-b146b6e0006d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:08.928055 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-77b5b24a-fbfa-44f3-a6a1-b146b6e0006d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:08.934002 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77b5b24a-fbfa-44f3-a6a1-b146b6e0006d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:08.934448 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77b5b24a-fbfa-44f3-a6a1-b146b6e0006d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:08.935196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77b5b24a-fbfa-44f3-a6a1-b146b6e0006d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:08.935622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77b5b24a-fbfa-44f3-a6a1-b146b6e0006d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:09.062785 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-77b5b24a-fbfa-44f3-a6a1-b146b6e0006d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:09.067977 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c3901762-0a23-4ef3-b4f1-bb4464d76480 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:09.068594 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c3901762-0a23-4ef3-b4f1-bb4464d76480 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:09.070316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-77b5b24a-fbfa-44f3-a6a1-b146b6e0006d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:09.072452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-77b5b24a-fbfa-44f3-a6a1-b146b6e0006d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:09.073807 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-77b5b24a-fbfa-44f3-a6a1-b146b6e0006d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.150261 Jul 12 13:44:09.074538 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 147/296] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:08 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:09.075177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c3901762-0a23-4ef3-b4f1-bb4464d76480 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:09.075713 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c3901762-0a23-4ef3-b4f1-bb4464d76480 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:09.076573 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c3901762-0a23-4ef3-b4f1-bb4464d76480 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:09.077103 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c3901762-0a23-4ef3-b4f1-bb4464d76480 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:09.258455 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5aef6389-e6fc-43e7-a26d-d272951f7163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:09.260485 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5aef6389-e6fc-43e7-a26d-d272951f7163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:09.267045 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5aef6389-e6fc-43e7-a26d-d272951f7163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:09.267498 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5aef6389-e6fc-43e7-a26d-d272951f7163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:09.268324 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5aef6389-e6fc-43e7-a26d-d272951f7163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:09.268758 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5aef6389-e6fc-43e7-a26d-d272951f7163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:09.322697 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c3901762-0a23-4ef3-b4f1-bb4464d76480 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:09.344629 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c3901762-0a23-4ef3-b4f1-bb4464d76480 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.280480 Jul 12 13:44:09.345596 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 150/297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:09 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:09.479846 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5aef6389-e6fc-43e7-a26d-d272951f7163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:09.488802 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5aef6389-e6fc-43e7-a26d-d272951f7163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1511 microversion: 2.1 time: 0.234677 Jul 12 13:44:09.489413 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 148/298] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:09 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:09.696465 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5e222149-f26a-4b52-a417-b566b86378c7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:09.698107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5e222149-f26a-4b52-a417-b566b86378c7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:09.708997 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5e222149-f26a-4b52-a417-b566b86378c7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:09.709591 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5e222149-f26a-4b52-a417-b566b86378c7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:09.710990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5e222149-f26a-4b52-a417-b566b86378c7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:09.711743 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5e222149-f26a-4b52-a417-b566b86378c7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:09.889551 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-1773bf90-dc1e-4ae2-bcf8-a1cb936b608f req-5c7feadf-9101-46e5-a71b-2d8b811d8529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c496f49-2bd0-4b55-bca1-6402b331e1a1", "tag": "dd8d0273-59e6-4628-b80c-fb8d75a315d0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:09.898137 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-1773bf90-dc1e-4ae2-bcf8-a1cb936b608f req-5c7feadf-9101-46e5-a71b-2d8b811d8529 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:09.898727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-1773bf90-dc1e-4ae2-bcf8-a1cb936b608f req-5c7feadf-9101-46e5-a71b-2d8b811d8529 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:09.916535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-1773bf90-dc1e-4ae2-bcf8-a1cb936b608f req-5c7feadf-9101-46e5-a71b-2d8b811d8529 service nova] Creating event network-changed:dd8d0273-59e6-4628-b80c-fb8d75a315d0 for instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 on hv-cinder-79797 Jul 12 13:44:09.921939 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-1773bf90-dc1e-4ae2-bcf8-a1cb936b608f req-5c7feadf-9101-46e5-a71b-2d8b811d8529 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035933 Jul 12 13:44:09.932266 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5e222149-f26a-4b52-a417-b566b86378c7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:09.937284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 149/299] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:44:09.947446 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5e222149-f26a-4b52-a417-b566b86378c7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1276 microversion: 2.1 time: 0.255906 Jul 12 13:44:09.948141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 151/300] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:09 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1276 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:10.094078 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-02276ae2-dad1-4bc5-89ec-d4f6b9ed74f0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:10.094783 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-02276ae2-dad1-4bc5-89ec-d4f6b9ed74f0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:10.102378 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02276ae2-dad1-4bc5-89ec-d4f6b9ed74f0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:10.102834 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02276ae2-dad1-4bc5-89ec-d4f6b9ed74f0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:10.103624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02276ae2-dad1-4bc5-89ec-d4f6b9ed74f0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:10.104064 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02276ae2-dad1-4bc5-89ec-d4f6b9ed74f0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:10.242633 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-02276ae2-dad1-4bc5-89ec-d4f6b9ed74f0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:10.253476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-02276ae2-dad1-4bc5-89ec-d4f6b9ed74f0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:10.256882 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-02276ae2-dad1-4bc5-89ec-d4f6b9ed74f0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:10.258558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-02276ae2-dad1-4bc5-89ec-d4f6b9ed74f0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.169317 Jul 12 13:44:10.260320 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 150/301] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:10 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:10.362107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a5fa2c16-427a-4ec7-8e05-e6858e09887e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:10.362750 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a5fa2c16-427a-4ec7-8e05-e6858e09887e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:10.369516 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a5fa2c16-427a-4ec7-8e05-e6858e09887e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:10.369981 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a5fa2c16-427a-4ec7-8e05-e6858e09887e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:10.370771 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a5fa2c16-427a-4ec7-8e05-e6858e09887e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:10.371209 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a5fa2c16-427a-4ec7-8e05-e6858e09887e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:10.503447 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a5fa2c16-427a-4ec7-8e05-e6858e09887e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:10.511364 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a5fa2c16-427a-4ec7-8e05-e6858e09887e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.153185 Jul 12 13:44:10.511870 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-77e9dc92-b9c0-4636-885a-18746b6c6c35 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:10.511994 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 152/302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:10 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:10.522050 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-77e9dc92-b9c0-4636-885a-18746b6c6c35 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:10.528621 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77e9dc92-b9c0-4636-885a-18746b6c6c35 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:10.529068 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77e9dc92-b9c0-4636-885a-18746b6c6c35 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:10.529834 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77e9dc92-b9c0-4636-885a-18746b6c6c35 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:10.530301 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77e9dc92-b9c0-4636-885a-18746b6c6c35 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:10.683023 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-77e9dc92-b9c0-4636-885a-18746b6c6c35 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:10.691104 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-77e9dc92-b9c0-4636-885a-18746b6c6c35 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1517 microversion: 2.1 time: 0.185963 Jul 12 13:44:10.691679 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 151/303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:10 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:10.966039 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1e4dce35-6f25-4694-8f52-c616c195a7f1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:10.967421 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1e4dce35-6f25-4694-8f52-c616c195a7f1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:10.974925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1e4dce35-6f25-4694-8f52-c616c195a7f1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:10.975792 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1e4dce35-6f25-4694-8f52-c616c195a7f1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:10.976914 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1e4dce35-6f25-4694-8f52-c616c195a7f1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:10.977905 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1e4dce35-6f25-4694-8f52-c616c195a7f1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:11.189930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1e4dce35-6f25-4694-8f52-c616c195a7f1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:11.198383 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1e4dce35-6f25-4694-8f52-c616c195a7f1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1276 microversion: 2.1 time: 0.237257 Jul 12 13:44:11.199694 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 153/304] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:10 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:11.276801 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6e73d638-9d20-4aa6-bcce-8f4c332df4c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:11.277427 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6e73d638-9d20-4aa6-bcce-8f4c332df4c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:11.285077 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e73d638-9d20-4aa6-bcce-8f4c332df4c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:11.285532 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e73d638-9d20-4aa6-bcce-8f4c332df4c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:11.287047 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e73d638-9d20-4aa6-bcce-8f4c332df4c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:11.287691 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e73d638-9d20-4aa6-bcce-8f4c332df4c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:11.436558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6e73d638-9d20-4aa6-bcce-8f4c332df4c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:11.441115 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-51e8cd16-9df5-4dbe-933e-11f7d4dbab51 req-6b711539-4c0b-4779-9c0a-5e389ddc9018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc4f645-5c2b-4346-b730-0dff41046431", "name": "network-vif-plugged", "status": "completed", "tag": "f5c34854-96a1-481a-80a7-dd3a6412961b"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:11.448107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6e73d638-9d20-4aa6-bcce-8f4c332df4c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:11.449661 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6e73d638-9d20-4aa6-bcce-8f4c332df4c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:11.451050 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6e73d638-9d20-4aa6-bcce-8f4c332df4c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.178308 Jul 12 13:44:11.452130 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 152/305] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:11 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:11.464088 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-51e8cd16-9df5-4dbe-933e-11f7d4dbab51 req-6b711539-4c0b-4779-9c0a-5e389ddc9018 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:11.464573 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-51e8cd16-9df5-4dbe-933e-11f7d4dbab51 req-6b711539-4c0b-4779-9c0a-5e389ddc9018 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:11.477413 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-51e8cd16-9df5-4dbe-933e-11f7d4dbab51 req-6b711539-4c0b-4779-9c0a-5e389ddc9018 service nova] Creating event network-vif-plugged:f5c34854-96a1-481a-80a7-dd3a6412961b for instance 6dc4f645-5c2b-4346-b730-0dff41046431 on hv-cinder-79797 Jul 12 13:44:11.482236 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-51e8cd16-9df5-4dbe-933e-11f7d4dbab51 req-6b711539-4c0b-4779-9c0a-5e389ddc9018 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044940 Jul 12 13:44:11.482829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 154/306] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:44:11.529383 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-40ed89e6-9610-4d59-afc4-b859fdcb274e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:11.530346 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-40ed89e6-9610-4d59-afc4-b859fdcb274e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:11.538295 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40ed89e6-9610-4d59-afc4-b859fdcb274e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:11.539020 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40ed89e6-9610-4d59-afc4-b859fdcb274e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:11.539871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40ed89e6-9610-4d59-afc4-b859fdcb274e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:11.540511 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40ed89e6-9610-4d59-afc4-b859fdcb274e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:11.676102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-532aefce-ae12-4fc0-b5be-bb70d9c963da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:11.683735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-532aefce-ae12-4fc0-b5be-bb70d9c963da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:11.684442 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-532aefce-ae12-4fc0-b5be-bb70d9c963da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:11.710357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-40ed89e6-9610-4d59-afc4-b859fdcb274e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:11.724728 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-40ed89e6-9610-4d59-afc4-b859fdcb274e tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.199298 Jul 12 13:44:11.726308 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 153/307] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:11 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:11.754094 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-532aefce-ae12-4fc0-b5be-bb70d9c963da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Going to try to stop instance {{(pid=124465) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 13:44:11.798243 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-532aefce-ae12-4fc0-b5be-bb70d9c963da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/action" status: 202 len: 0 microversion: 2.1 time: 0.127036 Jul 12 13:44:11.798893 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 155/308] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:44:11 2022] POST /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 13:44:11.807205 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-77136131-ab47-430e-a3a3-6d292501e546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:11.807829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-77136131-ab47-430e-a3a3-6d292501e546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:11.813835 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77136131-ab47-430e-a3a3-6d292501e546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:11.814401 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77136131-ab47-430e-a3a3-6d292501e546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:11.815167 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77136131-ab47-430e-a3a3-6d292501e546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:11.815616 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-77136131-ab47-430e-a3a3-6d292501e546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:11.942917 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-77136131-ab47-430e-a3a3-6d292501e546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:11.951035 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-77136131-ab47-430e-a3a3-6d292501e546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.147587 Jul 12 13:44:11.951599 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 154/309] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:11 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:12.043890 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-32107b44-1785-421d-92d4-c57964b31abe tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'create', calling method: .version_select at 0x7f3a160b2a60>, body: {"keypair": {"name": "tempest-keypair-1796573232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7FSNtr30NtH3401xMc+Kp4B4WSuJh84q2pMc65Q/8KjiUoQuYKKAGLEMaQqct9JtNUo1oZro7ifpuH7tzZEiNkOjRms1OLF3A5LpbVK5kQkLw87OMHRBZgOAH8VjMw+Q=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:12.059661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-32107b44-1785-421d-92d4-c57964b31abe tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Getting quotas for project 026f214eb4ee4a9c807b928710c93db5. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:44:12.063601 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-32107b44-1785-421d-92d4-c57964b31abe tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Getting quotas for user 4a6b3bd40ad744908a05df7410cace52 and project 026f214eb4ee4a9c807b928710c93db5. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:44:12.086684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-32107b44-1785-421d-92d4-c57964b31abe tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047304 Jul 12 13:44:12.087295 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 156/310] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jul 12 13:44:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:44:12.215813 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-15b4d7d4-c960-4209-81b4-5e0106adefdc tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:12.216608 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-15b4d7d4-c960-4209-81b4-5e0106adefdc tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:12.222612 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-15b4d7d4-c960-4209-81b4-5e0106adefdc tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:12.223184 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-15b4d7d4-c960-4209-81b4-5e0106adefdc tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:12.224570 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-15b4d7d4-c960-4209-81b4-5e0106adefdc tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:12.225011 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-15b4d7d4-c960-4209-81b4-5e0106adefdc tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:12.231191 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:12.367480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-15b4d7d4-c960-4209-81b4-5e0106adefdc tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:12.374972 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-15b4d7d4-c960-4209-81b4-5e0106adefdc tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.163047 Jul 12 13:44:12.375543 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 155/311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:12 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:12.468670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-30a83983-a53b-47ff-a191-9861a092b78b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:12.469536 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-30a83983-a53b-47ff-a191-9861a092b78b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:12.476600 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-30a83983-a53b-47ff-a191-9861a092b78b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:12.477064 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-30a83983-a53b-47ff-a191-9861a092b78b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:12.477819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-30a83983-a53b-47ff-a191-9861a092b78b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:12.478285 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-30a83983-a53b-47ff-a191-9861a092b78b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:12.482482 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:12.694847 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-30a83983-a53b-47ff-a191-9861a092b78b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:12.702937 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-30a83983-a53b-47ff-a191-9861a092b78b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:12.704474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-30a83983-a53b-47ff-a191-9861a092b78b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:12.705637 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-30a83983-a53b-47ff-a191-9861a092b78b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.240958 Jul 12 13:44:12.706223 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 157/312] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:12 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:12.743417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9a01666c-4677-4e54-9224-f66a3705ee60 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:12.744035 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9a01666c-4677-4e54-9224-f66a3705ee60 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:12.750533 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a01666c-4677-4e54-9224-f66a3705ee60 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:12.750988 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a01666c-4677-4e54-9224-f66a3705ee60 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:12.752038 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a01666c-4677-4e54-9224-f66a3705ee60 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:12.752480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a01666c-4677-4e54-9224-f66a3705ee60 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:12.889393 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9a01666c-4677-4e54-9224-f66a3705ee60 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:12.897732 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9a01666c-4677-4e54-9224-f66a3705ee60 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.158765 Jul 12 13:44:12.898344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 156/313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:12 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:12.968761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-83288a65-11e5-49eb-9776-ca1d24dc1016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:12.969533 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-83288a65-11e5-49eb-9776-ca1d24dc1016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:12.976737 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83288a65-11e5-49eb-9776-ca1d24dc1016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:12.977262 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83288a65-11e5-49eb-9776-ca1d24dc1016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:12.978400 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83288a65-11e5-49eb-9776-ca1d24dc1016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:12.978838 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83288a65-11e5-49eb-9776-ca1d24dc1016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:13.151301 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-83288a65-11e5-49eb-9776-ca1d24dc1016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:13.159719 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-83288a65-11e5-49eb-9776-ca1d24dc1016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.194972 Jul 12 13:44:13.160284 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 158/314] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:12 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:13.392562 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e7918d9e-e727-4085-816f-cdb942e94aea tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:13.393173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e7918d9e-e727-4085-816f-cdb942e94aea tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:13.399628 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e7918d9e-e727-4085-816f-cdb942e94aea tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:13.400170 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e7918d9e-e727-4085-816f-cdb942e94aea tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:13.401130 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e7918d9e-e727-4085-816f-cdb942e94aea tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:13.401573 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e7918d9e-e727-4085-816f-cdb942e94aea tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:13.519773 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-829313034", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "65fde899-6b5b-4bfd-b67c-81e8b9e24842"}], "security_groups": [{"name": "tempest-securitygroup--983492500"}], "key_name": "tempest-keypair-1796573232", "user_data": "}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:13.541125 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e7918d9e-e727-4085-816f-cdb942e94aea tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:13.548556 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e7918d9e-e727-4085-816f-cdb942e94aea tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.159782 Jul 12 13:44:13.549114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 157/315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:13 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:13.620539 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.network.neutron [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] validate_networks() for [('65fde899-6b5b-4bfd-b67c-81e8b9e24842', None, None, None, None, None)] {{(pid=124465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:44:13.724477 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-266336d2-0ac9-4c24-9060-951859ef8c12 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:13.725218 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-266336d2-0ac9-4c24-9060-951859ef8c12 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:13.726945 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:13.732499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-266336d2-0ac9-4c24-9060-951859ef8c12 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:13.732937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-266336d2-0ac9-4c24-9060-951859ef8c12 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:13.733711 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-266336d2-0ac9-4c24-9060-951859ef8c12 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:13.734175 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-266336d2-0ac9-4c24-9060-951859ef8c12 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:13.874779 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-266336d2-0ac9-4c24-9060-951859ef8c12 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:13.883831 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-266336d2-0ac9-4c24-9060-951859ef8c12 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:13.885362 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-266336d2-0ac9-4c24-9060-951859ef8c12 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:13.886579 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-266336d2-0ac9-4c24-9060-951859ef8c12 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.166631 Jul 12 13:44:13.887142 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 158/316] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:13 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:44:13.915639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6fc2f213-0541-4f42-b1f5-052839b9c5de tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:13.916166 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6fc2f213-0541-4f42-b1f5-052839b9c5de tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:13.922617 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6fc2f213-0541-4f42-b1f5-052839b9c5de tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:13.923070 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6fc2f213-0541-4f42-b1f5-052839b9c5de tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:13.923847 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6fc2f213-0541-4f42-b1f5-052839b9c5de tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:13.924287 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6fc2f213-0541-4f42-b1f5-052839b9c5de tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:14.057905 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6fc2f213-0541-4f42-b1f5-052839b9c5de tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:14.065391 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6fc2f213-0541-4f42-b1f5-052839b9c5de tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.153777 Jul 12 13:44:14.065953 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 159/317] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:13 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:14.160949 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8dd86b69-0052-40f1-8ad3-11e6b0dac53c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:14.161473 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8dd86b69-0052-40f1-8ad3-11e6b0dac53c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:14.163475 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=10 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:14.168930 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8dd86b69-0052-40f1-8ad3-11e6b0dac53c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:14.169531 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8dd86b69-0052-40f1-8ad3-11e6b0dac53c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:14.170098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8dd86b69-0052-40f1-8ad3-11e6b0dac53c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:14.170576 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8dd86b69-0052-40f1-8ad3-11e6b0dac53c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:14.196398 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8dd86b69-0052-40f1-8ad3-11e6b0dac53c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/ips" status: 200 len: 149 microversion: 2.1 time: 0.039256 Jul 12 13:44:14.196991 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 160/318] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jul 12 13:44:14 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:44:14.201613 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e16abc88-90fe-4407-b7ec-ca807210ccbd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:14.202386 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e16abc88-90fe-4407-b7ec-ca807210ccbd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:14.209142 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e16abc88-90fe-4407-b7ec-ca807210ccbd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:14.209593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e16abc88-90fe-4407-b7ec-ca807210ccbd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:14.210538 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e16abc88-90fe-4407-b7ec-ca807210ccbd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:14.210986 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e16abc88-90fe-4407-b7ec-ca807210ccbd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:14.234591 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Flavor limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:44:14.235100 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Image limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:44:14.235463 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Flavor pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:44:14.235867 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Image pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:44:14.236271 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:44:14.239216 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:14.249198 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:14.249645 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:14.250467 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:14.251131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:14.269181 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Getting quotas for project 026f214eb4ee4a9c807b928710c93db5. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:44:14.273464 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Getting quotas for user 4a6b3bd40ad744908a05df7410cace52 and project 026f214eb4ee4a9c807b928710c93db5. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:44:14.288037 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Going to run 1 instances... {{(pid=124465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:44:14.290611 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:44:14.344499 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3ec3fd8a-457b-47c2-9fee-023f44b939fd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.828673 Jul 12 13:44:14.349949 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 159/319] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:44:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 13:44:14.355637 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4e319225-f019-4c96-8eb4-d02263aed0fa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:14.356481 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4e319225-f019-4c96-8eb4-d02263aed0fa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:14.362131 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e16abc88-90fe-4407-b7ec-ca807210ccbd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:14.372114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e16abc88-90fe-4407-b7ec-ca807210ccbd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.174093 Jul 12 13:44:14.373051 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 161/320] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:14 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:14.416946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4e319225-f019-4c96-8eb4-d02263aed0fa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:14.429016 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4e319225-f019-4c96-8eb4-d02263aed0fa tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1245 microversion: 2.1 time: 0.076746 Jul 12 13:44:14.429827 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 160/321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:14 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:14.567389 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c8ae6c6f-0ea0-4dfb-a606-eabfc5b570d3 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:14.568194 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c8ae6c6f-0ea0-4dfb-a606-eabfc5b570d3 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:14.575428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8ae6c6f-0ea0-4dfb-a606-eabfc5b570d3 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:14.576119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8ae6c6f-0ea0-4dfb-a606-eabfc5b570d3 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:14.577078 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8ae6c6f-0ea0-4dfb-a606-eabfc5b570d3 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:14.577638 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c8ae6c6f-0ea0-4dfb-a606-eabfc5b570d3 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:14.726404 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c8ae6c6f-0ea0-4dfb-a606-eabfc5b570d3 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:14.735746 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c8ae6c6f-0ea0-4dfb-a606-eabfc5b570d3 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.173701 Jul 12 13:44:14.736352 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 162/322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:14 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:14.904970 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c9d7b9ef-78a6-4513-9930-f3841111fd51 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:14.905600 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c9d7b9ef-78a6-4513-9930-f3841111fd51 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:14.912258 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c9d7b9ef-78a6-4513-9930-f3841111fd51 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:14.912716 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c9d7b9ef-78a6-4513-9930-f3841111fd51 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:14.913476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c9d7b9ef-78a6-4513-9930-f3841111fd51 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:14.913920 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c9d7b9ef-78a6-4513-9930-f3841111fd51 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.046743 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c9d7b9ef-78a6-4513-9930-f3841111fd51 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:15.054771 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c9d7b9ef-78a6-4513-9930-f3841111fd51 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:15.056289 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c9d7b9ef-78a6-4513-9930-f3841111fd51 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:15.057440 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c9d7b9ef-78a6-4513-9930-f3841111fd51 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.156435 Jul 12 13:44:15.058018 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 161/323] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:14 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:15.082886 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-394aaed6-49e4-40ec-8d0a-d43f65a42984 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:15.083990 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-394aaed6-49e4-40ec-8d0a-d43f65a42984 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:15.089984 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-394aaed6-49e4-40ec-8d0a-d43f65a42984 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:15.090462 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-394aaed6-49e4-40ec-8d0a-d43f65a42984 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.091233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-394aaed6-49e4-40ec-8d0a-d43f65a42984 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:15.091681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-394aaed6-49e4-40ec-8d0a-d43f65a42984 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.236832 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-394aaed6-49e4-40ec-8d0a-d43f65a42984 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:15.244586 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-394aaed6-49e4-40ec-8d0a-d43f65a42984 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1313 microversion: 2.1 time: 0.165594 Jul 12 13:44:15.245156 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 163/324] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:15 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:15.389948 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e0f16c38-9b55-4cb4-a036-b02c58a82618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:15.391098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e0f16c38-9b55-4cb4-a036-b02c58a82618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:15.397605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e0f16c38-9b55-4cb4-a036-b02c58a82618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:15.398285 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e0f16c38-9b55-4cb4-a036-b02c58a82618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.399050 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e0f16c38-9b55-4cb4-a036-b02c58a82618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:15.399482 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e0f16c38-9b55-4cb4-a036-b02c58a82618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.446727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-83e92314-9294-4b39-bda5-e3be139a9527 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:15.447381 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-83e92314-9294-4b39-bda5-e3be139a9527 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:15.453485 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83e92314-9294-4b39-bda5-e3be139a9527 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:15.453974 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83e92314-9294-4b39-bda5-e3be139a9527 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.454749 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83e92314-9294-4b39-bda5-e3be139a9527 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:15.455194 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83e92314-9294-4b39-bda5-e3be139a9527 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.524790 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-83e92314-9294-4b39-bda5-e3be139a9527 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:15.532619 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-83e92314-9294-4b39-bda5-e3be139a9527 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1297 microversion: 2.1 time: 0.090166 Jul 12 13:44:15.538260 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 164/325] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:15 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:15.538562 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e0f16c38-9b55-4cb4-a036-b02c58a82618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:15.546086 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e0f16c38-9b55-4cb4-a036-b02c58a82618 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.159889 Jul 12 13:44:15.546770 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 162/326] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:15 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:15.610743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9167543f-40fd-4419-bf0d-7ef29eaf2944 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e79de655-e60f-4b68-a9e6-c72d6f92f4b6"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:15.611882 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9167543f-40fd-4419-bf0d-7ef29eaf2944 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:15.618531 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9167543f-40fd-4419-bf0d-7ef29eaf2944 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:15.618983 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9167543f-40fd-4419-bf0d-7ef29eaf2944 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.619746 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9167543f-40fd-4419-bf0d-7ef29eaf2944 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:15.620185 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9167543f-40fd-4419-bf0d-7ef29eaf2944 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.752972 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6d7a235f-d02f-4bea-9ff4-a01944fde8eb tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:15.753585 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6d7a235f-d02f-4bea-9ff4-a01944fde8eb tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:15.760875 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d7a235f-d02f-4bea-9ff4-a01944fde8eb tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:15.761669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d7a235f-d02f-4bea-9ff4-a01944fde8eb tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.762840 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d7a235f-d02f-4bea-9ff4-a01944fde8eb tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:15.763430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d7a235f-d02f-4bea-9ff4-a01944fde8eb tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:15.940478 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9167543f-40fd-4419-bf0d-7ef29eaf2944 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333109 Jul 12 13:44:15.941454 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 165/327] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:44:15 2022] POST /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:16.006947 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6d7a235f-d02f-4bea-9ff4-a01944fde8eb tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:16.027447 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6d7a235f-d02f-4bea-9ff4-a01944fde8eb tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.278548 Jul 12 13:44:16.032546 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 163/328] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:15 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:16.080562 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-29dffb88-ca84-4115-9335-882670f034ca tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:16.081496 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-29dffb88-ca84-4115-9335-882670f034ca tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:16.093538 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-29dffb88-ca84-4115-9335-882670f034ca tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:16.094069 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-29dffb88-ca84-4115-9335-882670f034ca tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:16.094845 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-29dffb88-ca84-4115-9335-882670f034ca tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:16.095309 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-29dffb88-ca84-4115-9335-882670f034ca tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:16.241909 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-29dffb88-ca84-4115-9335-882670f034ca tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:16.250552 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-29dffb88-ca84-4115-9335-882670f034ca tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:16.256525 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-29dffb88-ca84-4115-9335-882670f034ca tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:16.260534 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-29dffb88-ca84-4115-9335-882670f034ca tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.186995 Jul 12 13:44:16.261591 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-458e7007-61dc-4529-bed2-334fcce5443a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:16.262561 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-458e7007-61dc-4529-bed2-334fcce5443a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:16.263651 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 166/329] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:16 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:16.273026 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-458e7007-61dc-4529-bed2-334fcce5443a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:16.273801 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-458e7007-61dc-4529-bed2-334fcce5443a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:16.274721 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-458e7007-61dc-4529-bed2-334fcce5443a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:16.275725 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-458e7007-61dc-4529-bed2-334fcce5443a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:16.478212 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-458e7007-61dc-4529-bed2-334fcce5443a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:16.485572 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-458e7007-61dc-4529-bed2-334fcce5443a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1496 microversion: 2.1 time: 0.227730 Jul 12 13:44:16.486161 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 164/330] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:16 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1496 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:16.550848 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bc1a10b5-2155-419a-9042-7eacaa25ca88 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:16.551367 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bc1a10b5-2155-419a-9042-7eacaa25ca88 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:16.558034 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc1a10b5-2155-419a-9042-7eacaa25ca88 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:16.558482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc1a10b5-2155-419a-9042-7eacaa25ca88 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:16.559241 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc1a10b5-2155-419a-9042-7eacaa25ca88 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:16.559670 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc1a10b5-2155-419a-9042-7eacaa25ca88 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:16.568022 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-676b3b76-4b4a-4e67-a4c5-4da13bae82ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:16.568644 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-676b3b76-4b4a-4e67-a4c5-4da13bae82ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:16.575072 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-676b3b76-4b4a-4e67-a4c5-4da13bae82ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:16.575528 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-676b3b76-4b4a-4e67-a4c5-4da13bae82ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:16.576303 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-676b3b76-4b4a-4e67-a4c5-4da13bae82ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:16.576925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-676b3b76-4b4a-4e67-a4c5-4da13bae82ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:16.629088 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bc1a10b5-2155-419a-9042-7eacaa25ca88 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:16.636902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bc1a10b5-2155-419a-9042-7eacaa25ca88 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1303 microversion: 2.1 time: 0.090283 Jul 12 13:44:16.637588 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 167/331] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:16 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:16.800724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-676b3b76-4b4a-4e67-a4c5-4da13bae82ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:16.811918 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-676b3b76-4b4a-4e67-a4c5-4da13bae82ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.247811 Jul 12 13:44:16.814409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 165/332] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:16 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:17.050755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8fea922c-ea19-4d54-bd0b-77efdc72167f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:17.052114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8fea922c-ea19-4d54-bd0b-77efdc72167f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:17.061480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8fea922c-ea19-4d54-bd0b-77efdc72167f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.064109 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8fea922c-ea19-4d54-bd0b-77efdc72167f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.064984 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8fea922c-ea19-4d54-bd0b-77efdc72167f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.066833 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8fea922c-ea19-4d54-bd0b-77efdc72167f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.200548 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-18ccaaca-9c1c-4dc4-abc1-ce30469dbd7d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:17.201331 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-18ccaaca-9c1c-4dc4-abc1-ce30469dbd7d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:17.211059 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-18ccaaca-9c1c-4dc4-abc1-ce30469dbd7d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.211519 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-18ccaaca-9c1c-4dc4-abc1-ce30469dbd7d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.212458 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-18ccaaca-9c1c-4dc4-abc1-ce30469dbd7d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.212958 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-18ccaaca-9c1c-4dc4-abc1-ce30469dbd7d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.242266 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-18ccaaca-9c1c-4dc4-abc1-ce30469dbd7d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:44:17.250632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8fea922c-ea19-4d54-bd0b-77efdc72167f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:17.264271 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8fea922c-ea19-4d54-bd0b-77efdc72167f tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.216710 Jul 12 13:44:17.265939 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 168/333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:17 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:17.289041 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7981d2a5-24b1-477b-b488-47b970c56275 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:17.292092 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7981d2a5-24b1-477b-b488-47b970c56275 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:17.305166 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7981d2a5-24b1-477b-b488-47b970c56275 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.305812 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7981d2a5-24b1-477b-b488-47b970c56275 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.306810 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7981d2a5-24b1-477b-b488-47b970c56275 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.307455 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7981d2a5-24b1-477b-b488-47b970c56275 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.340159 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-18ccaaca-9c1c-4dc4-abc1-ce30469dbd7d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 204 len: 0 microversion: 2.1 time: 0.143557 Jul 12 13:44:17.341358 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 166/334] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:44:17 2022] DELETE /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 13:44:17.352418 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d72473bf-ea48-4ae0-b9f1-ba7d115044c5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:17.353324 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d72473bf-ea48-4ae0-b9f1-ba7d115044c5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:17.362331 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d72473bf-ea48-4ae0-b9f1-ba7d115044c5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.362787 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d72473bf-ea48-4ae0-b9f1-ba7d115044c5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.363569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d72473bf-ea48-4ae0-b9f1-ba7d115044c5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.363999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d72473bf-ea48-4ae0-b9f1-ba7d115044c5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.481197 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7981d2a5-24b1-477b-b488-47b970c56275 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:17.490660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7981d2a5-24b1-477b-b488-47b970c56275 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:17.492364 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7981d2a5-24b1-477b-b488-47b970c56275 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:17.493811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7981d2a5-24b1-477b-b488-47b970c56275 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.217093 Jul 12 13:44:17.494720 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 169/335] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:17 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:44:17.499178 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-750bf121-0dd3-497b-8156-3d7557fefdf9 req-0deec7df-fda8-4c78-884e-9f180224a5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c496f49-2bd0-4b55-bca1-6402b331e1a1", "name": "network-vif-plugged", "status": "completed", "tag": "dd8d0273-59e6-4628-b80c-fb8d75a315d0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:17.508199 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-750bf121-0dd3-497b-8156-3d7557fefdf9 req-0deec7df-fda8-4c78-884e-9f180224a5e5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.509019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-750bf121-0dd3-497b-8156-3d7557fefdf9 req-0deec7df-fda8-4c78-884e-9f180224a5e5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.523686 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-750bf121-0dd3-497b-8156-3d7557fefdf9 req-0deec7df-fda8-4c78-884e-9f180224a5e5 service nova] Creating event network-vif-plugged:dd8d0273-59e6-4628-b80c-fb8d75a315d0 for instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 on hv-cinder-79797 Jul 12 13:44:17.529324 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-750bf121-0dd3-497b-8156-3d7557fefdf9 req-0deec7df-fda8-4c78-884e-9f180224a5e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033407 Jul 12 13:44:17.530139 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 170/336] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:17.599214 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d72473bf-ea48-4ae0-b9f1-ba7d115044c5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:17.606916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d72473bf-ea48-4ae0-b9f1-ba7d115044c5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1502 microversion: 2.1 time: 0.260648 Jul 12 13:44:17.607606 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 167/337] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:17 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:17.657787 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aee3296f-8468-4e98-ba9d-dc112e0ca26c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:17.658621 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aee3296f-8468-4e98-ba9d-dc112e0ca26c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:17.666323 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aee3296f-8468-4e98-ba9d-dc112e0ca26c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.666784 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aee3296f-8468-4e98-ba9d-dc112e0ca26c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.667562 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aee3296f-8468-4e98-ba9d-dc112e0ca26c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.668006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aee3296f-8468-4e98-ba9d-dc112e0ca26c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.687395 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:17.808716 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aee3296f-8468-4e98-ba9d-dc112e0ca26c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:17.817224 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aee3296f-8468-4e98-ba9d-dc112e0ca26c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.165008 Jul 12 13:44:17.818738 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 171/338] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:17 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:17.832236 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4abb54b9-e8e7-4d92-a85a-ceb1c6f1ed05 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:17.832963 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4abb54b9-e8e7-4d92-a85a-ceb1c6f1ed05 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:17.839652 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4abb54b9-e8e7-4d92-a85a-ceb1c6f1ed05 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.840177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4abb54b9-e8e7-4d92-a85a-ceb1c6f1ed05 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.841017 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4abb54b9-e8e7-4d92-a85a-ceb1c6f1ed05 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.841523 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4abb54b9-e8e7-4d92-a85a-ceb1c6f1ed05 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.874036 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-6956e6eb-31c4-4dbb-8982-7211a12246a4 req-d44c5d2e-89da-4d41-ae84-b597fbdc3033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42ee030-0bf1-402b-b7f4-9c9a33ac5aee", "tag": "24703b74-9dc6-4b80-a6ab-4c0de6ab1334"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:17.883700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-6956e6eb-31c4-4dbb-8982-7211a12246a4 req-d44c5d2e-89da-4d41-ae84-b597fbdc3033 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:17.884156 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-6956e6eb-31c4-4dbb-8982-7211a12246a4 req-d44c5d2e-89da-4d41-ae84-b597fbdc3033 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:17.897843 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-6956e6eb-31c4-4dbb-8982-7211a12246a4 req-d44c5d2e-89da-4d41-ae84-b597fbdc3033 service nova] Creating event network-changed:24703b74-9dc6-4b80-a6ab-4c0de6ab1334 for instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee on hv-cinder-79797 Jul 12 13:44:17.904893 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-6956e6eb-31c4-4dbb-8982-7211a12246a4 req-d44c5d2e-89da-4d41-ae84-b597fbdc3033 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034354 Jul 12 13:44:17.905517 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 172/339] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:44:17.992923 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4abb54b9-e8e7-4d92-a85a-ceb1c6f1ed05 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:18.001156 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4abb54b9-e8e7-4d92-a85a-ceb1c6f1ed05 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.172925 Jul 12 13:44:18.001998 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 168/340] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:17 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:18.282363 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7e0abe48-722d-4972-9287-cf259eba959a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:18.283062 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7e0abe48-722d-4972-9287-cf259eba959a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:18.285662 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:18.292399 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e0abe48-722d-4972-9287-cf259eba959a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:18.292856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e0abe48-722d-4972-9287-cf259eba959a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:18.293625 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e0abe48-722d-4972-9287-cf259eba959a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:18.294102 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7e0abe48-722d-4972-9287-cf259eba959a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:18.434576 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7e0abe48-722d-4972-9287-cf259eba959a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:18.443486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7e0abe48-722d-4972-9287-cf259eba959a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.165255 Jul 12 13:44:18.444221 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 173/341] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:18 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:18.511574 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-83311d20-79a8-42c1-8162-46a83daed9b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:18.512543 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-83311d20-79a8-42c1-8162-46a83daed9b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:18.519936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83311d20-79a8-42c1-8162-46a83daed9b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:18.520474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83311d20-79a8-42c1-8162-46a83daed9b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:18.521340 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83311d20-79a8-42c1-8162-46a83daed9b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:18.521948 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83311d20-79a8-42c1-8162-46a83daed9b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:18.624174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d60d6107-c5c1-4518-9a76-9861e3e64b68 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:18.624919 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d60d6107-c5c1-4518-9a76-9861e3e64b68 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:18.631645 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d60d6107-c5c1-4518-9a76-9861e3e64b68 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:18.632063 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d60d6107-c5c1-4518-9a76-9861e3e64b68 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:18.632868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d60d6107-c5c1-4518-9a76-9861e3e64b68 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:18.633308 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d60d6107-c5c1-4518-9a76-9861e3e64b68 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:18.656293 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-83311d20-79a8-42c1-8162-46a83daed9b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:18.665047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-83311d20-79a8-42c1-8162-46a83daed9b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:18.666585 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-83311d20-79a8-42c1-8162-46a83daed9b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:18.667731 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-83311d20-79a8-42c1-8162-46a83daed9b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.160224 Jul 12 13:44:18.668287 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 169/342] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:18 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:18.762992 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d60d6107-c5c1-4518-9a76-9861e3e64b68 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:18.770449 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d60d6107-c5c1-4518-9a76-9861e3e64b68 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1502 microversion: 2.1 time: 0.150172 Jul 12 13:44:18.771489 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 174/343] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:18 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:18.835773 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d299f619-9e66-4de8-9750-d662c47cfc55 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:18.836581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d299f619-9e66-4de8-9750-d662c47cfc55 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:18.842774 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d299f619-9e66-4de8-9750-d662c47cfc55 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:18.843225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d299f619-9e66-4de8-9750-d662c47cfc55 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:18.844002 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d299f619-9e66-4de8-9750-d662c47cfc55 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:18.844440 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d299f619-9e66-4de8-9750-d662c47cfc55 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:19.016753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d299f619-9e66-4de8-9750-d662c47cfc55 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:19.019136 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c14b427c-81ea-415f-8a01-8479efe8baec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:19.019783 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c14b427c-81ea-415f-8a01-8479efe8baec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:19.025020 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d299f619-9e66-4de8-9750-d662c47cfc55 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.194093 Jul 12 13:44:19.025642 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 170/344] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:18 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:19.026580 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c14b427c-81ea-415f-8a01-8479efe8baec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:19.027036 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c14b427c-81ea-415f-8a01-8479efe8baec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:19.027816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c14b427c-81ea-415f-8a01-8479efe8baec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:19.028262 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c14b427c-81ea-415f-8a01-8479efe8baec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:19.162928 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c14b427c-81ea-415f-8a01-8479efe8baec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:19.171163 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c14b427c-81ea-415f-8a01-8479efe8baec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.155792 Jul 12 13:44:19.171734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 175/345] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:19 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:19.460948 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e9a3cfb7-35db-4172-980a-85c22a036fb7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:19.461522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e9a3cfb7-35db-4172-980a-85c22a036fb7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:19.467521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e9a3cfb7-35db-4172-980a-85c22a036fb7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:19.467973 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e9a3cfb7-35db-4172-980a-85c22a036fb7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:19.468737 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e9a3cfb7-35db-4172-980a-85c22a036fb7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:19.469176 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e9a3cfb7-35db-4172-980a-85c22a036fb7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:19.641889 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e9a3cfb7-35db-4172-980a-85c22a036fb7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:19.658762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e9a3cfb7-35db-4172-980a-85c22a036fb7 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.201957 Jul 12 13:44:19.669087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 171/346] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:19 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:19.687011 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3492d971-9dd0-43b7-8e62-32942e7dc8b6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:19.687899 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3492d971-9dd0-43b7-8e62-32942e7dc8b6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:19.695584 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3492d971-9dd0-43b7-8e62-32942e7dc8b6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:19.695997 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3492d971-9dd0-43b7-8e62-32942e7dc8b6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:19.701274 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3492d971-9dd0-43b7-8e62-32942e7dc8b6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:19.703722 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3492d971-9dd0-43b7-8e62-32942e7dc8b6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:19.793801 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6b14eea1-ccaf-4b67-b995-95f617c51f94 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:19.795735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6b14eea1-ccaf-4b67-b995-95f617c51f94 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:19.809200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6b14eea1-ccaf-4b67-b995-95f617c51f94 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:19.812356 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6b14eea1-ccaf-4b67-b995-95f617c51f94 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:19.813170 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6b14eea1-ccaf-4b67-b995-95f617c51f94 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:19.813618 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6b14eea1-ccaf-4b67-b995-95f617c51f94 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:19.882667 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6b14eea1-ccaf-4b67-b995-95f617c51f94 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:19.890626 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6b14eea1-ccaf-4b67-b995-95f617c51f94 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.105762 Jul 12 13:44:19.891240 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 172/347] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:19 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:19.895596 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-a2fa6e9b-d32d-462d-bd35-6c2aa86d546d req-e87fbe45-367a-449d-8aa4-94b27eff9fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc4f645-5c2b-4346-b730-0dff41046431", "name": "network-vif-deleted", "tag": "f5c34854-96a1-481a-80a7-dd3a6412961b"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:19.905196 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-a2fa6e9b-d32d-462d-bd35-6c2aa86d546d req-e87fbe45-367a-449d-8aa4-94b27eff9fdc service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:19.905644 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-a2fa6e9b-d32d-462d-bd35-6c2aa86d546d req-e87fbe45-367a-449d-8aa4-94b27eff9fdc service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:19.910302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3492d971-9dd0-43b7-8e62-32942e7dc8b6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:19.917953 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-a2fa6e9b-d32d-462d-bd35-6c2aa86d546d req-e87fbe45-367a-449d-8aa4-94b27eff9fdc service nova] Creating event network-vif-deleted:f5c34854-96a1-481a-80a7-dd3a6412961b for instance 6dc4f645-5c2b-4346-b730-0dff41046431 on hv-cinder-79797 Jul 12 13:44:19.919104 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3492d971-9dd0-43b7-8e62-32942e7dc8b6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:19.920688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3492d971-9dd0-43b7-8e62-32942e7dc8b6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:19.921886 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3492d971-9dd0-43b7-8e62-32942e7dc8b6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.239419 Jul 12 13:44:19.922472 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 176/348] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:19 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:19.923190 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-a2fa6e9b-d32d-462d-bd35-6c2aa86d546d req-e87fbe45-367a-449d-8aa4-94b27eff9fdc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030848 Jul 12 13:44:19.923718 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 173/349] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:20.041983 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a353e7d5-a54a-4b37-bf9c-bc7efb9c7046 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:20.042561 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a353e7d5-a54a-4b37-bf9c-bc7efb9c7046 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:20.048554 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a353e7d5-a54a-4b37-bf9c-bc7efb9c7046 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:20.049008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a353e7d5-a54a-4b37-bf9c-bc7efb9c7046 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:20.049776 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a353e7d5-a54a-4b37-bf9c-bc7efb9c7046 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:20.050246 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a353e7d5-a54a-4b37-bf9c-bc7efb9c7046 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:20.177434 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a353e7d5-a54a-4b37-bf9c-bc7efb9c7046 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:20.184775 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a353e7d5-a54a-4b37-bf9c-bc7efb9c7046 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.146577 Jul 12 13:44:20.185297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 177/350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:20 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:20.190630 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-10b2f11d-42b2-4a1b-8ba4-8fa3a99ff9dd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:20.191429 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-10b2f11d-42b2-4a1b-8ba4-8fa3a99ff9dd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:20.197866 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-10b2f11d-42b2-4a1b-8ba4-8fa3a99ff9dd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:20.198344 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-10b2f11d-42b2-4a1b-8ba4-8fa3a99ff9dd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:20.199099 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-10b2f11d-42b2-4a1b-8ba4-8fa3a99ff9dd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:20.199560 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-10b2f11d-42b2-4a1b-8ba4-8fa3a99ff9dd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:20.214709 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:20.337415 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-10b2f11d-42b2-4a1b-8ba4-8fa3a99ff9dd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:20.345640 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-10b2f11d-42b2-4a1b-8ba4-8fa3a99ff9dd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.159100 Jul 12 13:44:20.346260 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 174/351] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:20 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:20.676284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2ec9533a-ccf4-4b58-a8ca-97aa4a7243ef tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:20.676896 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2ec9533a-ccf4-4b58-a8ca-97aa4a7243ef tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:20.683635 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2ec9533a-ccf4-4b58-a8ca-97aa4a7243ef tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:20.684094 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2ec9533a-ccf4-4b58-a8ca-97aa4a7243ef tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:20.684869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2ec9533a-ccf4-4b58-a8ca-97aa4a7243ef tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:20.685315 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2ec9533a-ccf4-4b58-a8ca-97aa4a7243ef tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:20.816718 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2ec9533a-ccf4-4b58-a8ca-97aa4a7243ef tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:20.825237 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2ec9533a-ccf4-4b58-a8ca-97aa4a7243ef tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.152830 Jul 12 13:44:20.825813 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 178/352] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:20 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:20.907935 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bcb46799-8a87-4dac-9e47-94c42020e4dd tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:20.908540 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bcb46799-8a87-4dac-9e47-94c42020e4dd tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:20.915081 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bcb46799-8a87-4dac-9e47-94c42020e4dd tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:20.915525 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bcb46799-8a87-4dac-9e47-94c42020e4dd tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:20.916274 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bcb46799-8a87-4dac-9e47-94c42020e4dd tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:20.916704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bcb46799-8a87-4dac-9e47-94c42020e4dd tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:20.940019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-54acd910-4aba-43f8-92ce-c4431a31f443 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:20.940535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-54acd910-4aba-43f8-92ce-c4431a31f443 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:20.947186 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54acd910-4aba-43f8-92ce-c4431a31f443 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:20.947651 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54acd910-4aba-43f8-92ce-c4431a31f443 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:20.948463 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54acd910-4aba-43f8-92ce-c4431a31f443 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:20.948903 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-54acd910-4aba-43f8-92ce-c4431a31f443 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:20.978545 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bcb46799-8a87-4dac-9e47-94c42020e4dd tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:20.986327 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bcb46799-8a87-4dac-9e47-94c42020e4dd tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.082383 Jul 12 13:44:20.987083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 175/353] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:20 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:21.078934 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-54acd910-4aba-43f8-92ce-c4431a31f443 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:21.087250 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-54acd910-4aba-43f8-92ce-c4431a31f443 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:21.088746 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-54acd910-4aba-43f8-92ce-c4431a31f443 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:21.089890 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-54acd910-4aba-43f8-92ce-c4431a31f443 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.153861 Jul 12 13:44:21.090471 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 179/354] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:20 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:44:21.201277 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-242ba36b-4b20-4599-8bd0-39358747ed19 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:21.201832 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-242ba36b-4b20-4599-8bd0-39358747ed19 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:21.208322 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-242ba36b-4b20-4599-8bd0-39358747ed19 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:21.208774 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-242ba36b-4b20-4599-8bd0-39358747ed19 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:21.209542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-242ba36b-4b20-4599-8bd0-39358747ed19 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:21.210004 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-242ba36b-4b20-4599-8bd0-39358747ed19 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:21.335780 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-242ba36b-4b20-4599-8bd0-39358747ed19 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:21.343406 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-242ba36b-4b20-4599-8bd0-39358747ed19 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.146025 Jul 12 13:44:21.343971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 176/355] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:21 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:21.363342 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6c6a5d20-3ae2-4c5f-aba1-de84de021d56 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:21.363954 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6c6a5d20-3ae2-4c5f-aba1-de84de021d56 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:21.370588 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c6a5d20-3ae2-4c5f-aba1-de84de021d56 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:21.371043 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c6a5d20-3ae2-4c5f-aba1-de84de021d56 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:21.371892 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c6a5d20-3ae2-4c5f-aba1-de84de021d56 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:21.372334 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c6a5d20-3ae2-4c5f-aba1-de84de021d56 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:21.502870 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6c6a5d20-3ae2-4c5f-aba1-de84de021d56 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:21.511141 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6c6a5d20-3ae2-4c5f-aba1-de84de021d56 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.151644 Jul 12 13:44:21.511700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 180/356] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:21 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:21.841877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-52cb05e2-5853-4a51-9848-c8d846fef49a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:21.842419 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-52cb05e2-5853-4a51-9848-c8d846fef49a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:21.849688 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-52cb05e2-5853-4a51-9848-c8d846fef49a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:21.849688 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-52cb05e2-5853-4a51-9848-c8d846fef49a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:21.850449 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-52cb05e2-5853-4a51-9848-c8d846fef49a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:21.850881 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-52cb05e2-5853-4a51-9848-c8d846fef49a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:21.983792 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-52cb05e2-5853-4a51-9848-c8d846fef49a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:21.991380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-52cb05e2-5853-4a51-9848-c8d846fef49a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.153397 Jul 12 13:44:21.991951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 177/357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:21 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:22.004028 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0405f83f-fff4-434c-b3ab-acca7c1fc708 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:22.004633 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0405f83f-fff4-434c-b3ab-acca7c1fc708 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:22.011898 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0405f83f-fff4-434c-b3ab-acca7c1fc708 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:22.012351 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0405f83f-fff4-434c-b3ab-acca7c1fc708 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:22.013100 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0405f83f-fff4-434c-b3ab-acca7c1fc708 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:22.013537 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0405f83f-fff4-434c-b3ab-acca7c1fc708 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:22.074902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0405f83f-fff4-434c-b3ab-acca7c1fc708 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:22.082248 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0405f83f-fff4-434c-b3ab-acca7c1fc708 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.082249 Jul 12 13:44:22.082800 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 181/358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:21 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:22.106781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-edc9bb2f-5a96-41b7-a589-e5324dcecc03 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:22.107453 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-edc9bb2f-5a96-41b7-a589-e5324dcecc03 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:22.113381 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-edc9bb2f-5a96-41b7-a589-e5324dcecc03 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:22.113826 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-edc9bb2f-5a96-41b7-a589-e5324dcecc03 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:22.114616 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-edc9bb2f-5a96-41b7-a589-e5324dcecc03 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:22.115054 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-edc9bb2f-5a96-41b7-a589-e5324dcecc03 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:22.239689 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-edc9bb2f-5a96-41b7-a589-e5324dcecc03 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:22.248532 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-edc9bb2f-5a96-41b7-a589-e5324dcecc03 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:22.250074 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-edc9bb2f-5a96-41b7-a589-e5324dcecc03 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:22.251223 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-edc9bb2f-5a96-41b7-a589-e5324dcecc03 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.148346 Jul 12 13:44:22.252030 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 178/359] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:22 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:22.360467 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9fa7bc32-3cc8-4510-b47d-a43181a90d4a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:22.361007 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9fa7bc32-3cc8-4510-b47d-a43181a90d4a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:22.367643 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9fa7bc32-3cc8-4510-b47d-a43181a90d4a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:22.368095 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9fa7bc32-3cc8-4510-b47d-a43181a90d4a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:22.368856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9fa7bc32-3cc8-4510-b47d-a43181a90d4a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:22.369295 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9fa7bc32-3cc8-4510-b47d-a43181a90d4a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:22.497562 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9fa7bc32-3cc8-4510-b47d-a43181a90d4a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:22.505912 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9fa7bc32-3cc8-4510-b47d-a43181a90d4a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.148696 Jul 12 13:44:22.506497 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 182/360] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:22 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:22.527809 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-dc1156d9-074d-4fc6-9214-748f4a3814ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:22.528422 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-dc1156d9-074d-4fc6-9214-748f4a3814ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:22.534339 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dc1156d9-074d-4fc6-9214-748f4a3814ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:22.534790 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dc1156d9-074d-4fc6-9214-748f4a3814ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:22.535543 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dc1156d9-074d-4fc6-9214-748f4a3814ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:22.535980 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dc1156d9-074d-4fc6-9214-748f4a3814ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:22.665014 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-dc1156d9-074d-4fc6-9214-748f4a3814ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:22.673117 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-dc1156d9-074d-4fc6-9214-748f4a3814ce tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.149027 Jul 12 13:44:22.673719 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 179/361] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:22 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:23.008460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c334e4b1-d200-470f-b4ea-28e0183c3bc4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:23.009082 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c334e4b1-d200-470f-b4ea-28e0183c3bc4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:23.016256 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c334e4b1-d200-470f-b4ea-28e0183c3bc4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:23.017215 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c334e4b1-d200-470f-b4ea-28e0183c3bc4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:23.018710 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c334e4b1-d200-470f-b4ea-28e0183c3bc4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:23.019201 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c334e4b1-d200-470f-b4ea-28e0183c3bc4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:23.101071 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-de800664-703f-41b0-8b73-c864f61fa4e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:23.101685 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-de800664-703f-41b0-8b73-c864f61fa4e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:23.108255 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-de800664-703f-41b0-8b73-c864f61fa4e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:23.108703 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-de800664-703f-41b0-8b73-c864f61fa4e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:23.109470 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-de800664-703f-41b0-8b73-c864f61fa4e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:23.109907 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-de800664-703f-41b0-8b73-c864f61fa4e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:23.154865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c334e4b1-d200-470f-b4ea-28e0183c3bc4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:23.163017 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c334e4b1-d200-470f-b4ea-28e0183c3bc4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.158558 Jul 12 13:44:23.163588 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 183/362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:23 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:23.175160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-de800664-703f-41b0-8b73-c864f61fa4e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:23.182941 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-de800664-703f-41b0-8b73-c864f61fa4e1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.086235 Jul 12 13:44:23.183516 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 180/363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:23 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:23.269739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-928b39f3-be92-4885-93d1-9f501f79a75e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:23.270844 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-928b39f3-be92-4885-93d1-9f501f79a75e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:23.276856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-928b39f3-be92-4885-93d1-9f501f79a75e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:23.277306 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-928b39f3-be92-4885-93d1-9f501f79a75e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:23.278095 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-928b39f3-be92-4885-93d1-9f501f79a75e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:23.278535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-928b39f3-be92-4885-93d1-9f501f79a75e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:23.407661 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-928b39f3-be92-4885-93d1-9f501f79a75e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:23.416199 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-928b39f3-be92-4885-93d1-9f501f79a75e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:23.417715 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-928b39f3-be92-4885-93d1-9f501f79a75e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:23.418896 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-928b39f3-be92-4885-93d1-9f501f79a75e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.153070 Jul 12 13:44:23.419582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 184/364] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:23 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:23.523053 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d11c4eac-99ba-445b-9de0-1311b9a37df7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:23.523664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d11c4eac-99ba-445b-9de0-1311b9a37df7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:23.529659 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d11c4eac-99ba-445b-9de0-1311b9a37df7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:23.530156 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d11c4eac-99ba-445b-9de0-1311b9a37df7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:23.530922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d11c4eac-99ba-445b-9de0-1311b9a37df7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:23.531363 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d11c4eac-99ba-445b-9de0-1311b9a37df7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:23.655219 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d11c4eac-99ba-445b-9de0-1311b9a37df7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:23.662548 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d11c4eac-99ba-445b-9de0-1311b9a37df7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.143986 Jul 12 13:44:23.663114 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 181/365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:23 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:23.690955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-84b8b1b0-c970-4f07-9139-a3a04d0c51da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:23.691563 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-84b8b1b0-c970-4f07-9139-a3a04d0c51da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:23.698030 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-84b8b1b0-c970-4f07-9139-a3a04d0c51da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:23.698486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-84b8b1b0-c970-4f07-9139-a3a04d0c51da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:23.699250 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-84b8b1b0-c970-4f07-9139-a3a04d0c51da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:23.699691 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-84b8b1b0-c970-4f07-9139-a3a04d0c51da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:24.039436 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-84b8b1b0-c970-4f07-9139-a3a04d0c51da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:24.047308 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-84b8b1b0-c970-4f07-9139-a3a04d0c51da tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.360132 Jul 12 13:44:24.048059 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 185/366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:23 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:24.180375 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-21fdefe4-4480-4a21-9e66-548d982027e4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:24.181008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-21fdefe4-4480-4a21-9e66-548d982027e4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:24.187560 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-21fdefe4-4480-4a21-9e66-548d982027e4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:24.188313 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-21fdefe4-4480-4a21-9e66-548d982027e4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:24.189113 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-21fdefe4-4480-4a21-9e66-548d982027e4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:24.189780 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-21fdefe4-4480-4a21-9e66-548d982027e4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:24.201082 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4ca692e5-c774-4442-9e6c-2e03e072a32c tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:24.201821 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4ca692e5-c774-4442-9e6c-2e03e072a32c tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:24.208717 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ca692e5-c774-4442-9e6c-2e03e072a32c tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:24.209161 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ca692e5-c774-4442-9e6c-2e03e072a32c tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:24.209922 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ca692e5-c774-4442-9e6c-2e03e072a32c tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:24.210981 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ca692e5-c774-4442-9e6c-2e03e072a32c tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:24.260504 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:24.274123 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4ca692e5-c774-4442-9e6c-2e03e072a32c tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:24.282580 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4ca692e5-c774-4442-9e6c-2e03e072a32c tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.085225 Jul 12 13:44:24.283383 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 186/367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:24 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:24.329704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-21fdefe4-4480-4a21-9e66-548d982027e4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:24.337213 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-21fdefe4-4480-4a21-9e66-548d982027e4 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.161107 Jul 12 13:44:24.337781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 182/368] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:24 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:24.436889 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-60c84919-0f0f-47b9-91f4-e936f6ca96da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:24.437498 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-60c84919-0f0f-47b9-91f4-e936f6ca96da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:24.443515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60c84919-0f0f-47b9-91f4-e936f6ca96da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:24.443966 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60c84919-0f0f-47b9-91f4-e936f6ca96da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:24.444725 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60c84919-0f0f-47b9-91f4-e936f6ca96da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:24.445167 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-60c84919-0f0f-47b9-91f4-e936f6ca96da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:24.574367 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-60c84919-0f0f-47b9-91f4-e936f6ca96da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:24.582571 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-60c84919-0f0f-47b9-91f4-e936f6ca96da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:24.584107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-60c84919-0f0f-47b9-91f4-e936f6ca96da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:24.585254 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-60c84919-0f0f-47b9-91f4-e936f6ca96da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.152316 Jul 12 13:44:24.585801 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 187/369] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:24 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:24.679249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4b8d648b-1a79-4146-9e6d-977121f2d94d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:24.679851 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4b8d648b-1a79-4146-9e6d-977121f2d94d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:24.681640 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=12 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:24.687192 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b8d648b-1a79-4146-9e6d-977121f2d94d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:24.687634 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b8d648b-1a79-4146-9e6d-977121f2d94d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:24.688381 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b8d648b-1a79-4146-9e6d-977121f2d94d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:24.688813 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b8d648b-1a79-4146-9e6d-977121f2d94d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:24.816214 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4b8d648b-1a79-4146-9e6d-977121f2d94d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:24.823532 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4b8d648b-1a79-4146-9e6d-977121f2d94d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.148233 Jul 12 13:44:24.824087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 183/370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:24 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:25.064545 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c032256f-beac-4ee3-9f1f-26d3dff4eb58 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:25.065069 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c032256f-beac-4ee3-9f1f-26d3dff4eb58 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:25.072155 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c032256f-beac-4ee3-9f1f-26d3dff4eb58 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:25.072602 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c032256f-beac-4ee3-9f1f-26d3dff4eb58 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:25.073347 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c032256f-beac-4ee3-9f1f-26d3dff4eb58 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:25.073803 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c032256f-beac-4ee3-9f1f-26d3dff4eb58 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:25.198929 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c032256f-beac-4ee3-9f1f-26d3dff4eb58 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:25.202285 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:25.207473 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c032256f-beac-4ee3-9f1f-26d3dff4eb58 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.146805 Jul 12 13:44:25.208643 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 188/371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:25 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:25.299864 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c0b13fa8-b8be-4c7c-b38e-e9ada2683681 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:25.300483 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c0b13fa8-b8be-4c7c-b38e-e9ada2683681 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:25.307088 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c0b13fa8-b8be-4c7c-b38e-e9ada2683681 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:25.307579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c0b13fa8-b8be-4c7c-b38e-e9ada2683681 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:25.308457 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c0b13fa8-b8be-4c7c-b38e-e9ada2683681 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:25.308895 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c0b13fa8-b8be-4c7c-b38e-e9ada2683681 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:25.355829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8fa3823c-c916-4a9e-9442-34c396ee5362 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:25.356517 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8fa3823c-c916-4a9e-9442-34c396ee5362 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:25.362413 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8fa3823c-c916-4a9e-9442-34c396ee5362 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:25.362859 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8fa3823c-c916-4a9e-9442-34c396ee5362 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:25.363614 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8fa3823c-c916-4a9e-9442-34c396ee5362 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:25.364524 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8fa3823c-c916-4a9e-9442-34c396ee5362 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:25.373461 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c0b13fa8-b8be-4c7c-b38e-e9ada2683681 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:25.383425 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c0b13fa8-b8be-4c7c-b38e-e9ada2683681 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.086798 Jul 12 13:44:25.384202 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 184/372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:25 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:25.493813 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8fa3823c-c916-4a9e-9442-34c396ee5362 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:25.501944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8fa3823c-c916-4a9e-9442-34c396ee5362 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.149622 Jul 12 13:44:25.502524 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 189/373] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:25 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:25.603666 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a6123060-d51b-4b6e-951f-89c4e0c36a4a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:25.604278 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a6123060-d51b-4b6e-951f-89c4e0c36a4a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:25.610267 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a6123060-d51b-4b6e-951f-89c4e0c36a4a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:25.610721 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a6123060-d51b-4b6e-951f-89c4e0c36a4a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:25.611485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a6123060-d51b-4b6e-951f-89c4e0c36a4a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:25.611924 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a6123060-d51b-4b6e-951f-89c4e0c36a4a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:25.739338 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a6123060-d51b-4b6e-951f-89c4e0c36a4a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:25.747089 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a6123060-d51b-4b6e-951f-89c4e0c36a4a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:25.748591 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a6123060-d51b-4b6e-951f-89c4e0c36a4a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:25.749730 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a6123060-d51b-4b6e-951f-89c4e0c36a4a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.149984 Jul 12 13:44:25.750307 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 185/374] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:25 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:25.840078 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3edd8536-5ccc-4db9-a9a7-8ef4321d6f86 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:25.840606 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3edd8536-5ccc-4db9-a9a7-8ef4321d6f86 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:25.846633 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3edd8536-5ccc-4db9-a9a7-8ef4321d6f86 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:25.847081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3edd8536-5ccc-4db9-a9a7-8ef4321d6f86 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:25.848179 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3edd8536-5ccc-4db9-a9a7-8ef4321d6f86 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:25.848278 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3edd8536-5ccc-4db9-a9a7-8ef4321d6f86 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:25.979778 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3edd8536-5ccc-4db9-a9a7-8ef4321d6f86 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:25.987094 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3edd8536-5ccc-4db9-a9a7-8ef4321d6f86 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.150922 Jul 12 13:44:25.987822 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 190/375] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:25 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:26.224834 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ae408a59-1b08-46ae-8db0-ee75ef356c66 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:26.225445 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ae408a59-1b08-46ae-8db0-ee75ef356c66 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:26.231558 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae408a59-1b08-46ae-8db0-ee75ef356c66 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:26.232009 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae408a59-1b08-46ae-8db0-ee75ef356c66 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:26.232774 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae408a59-1b08-46ae-8db0-ee75ef356c66 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:26.233285 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ae408a59-1b08-46ae-8db0-ee75ef356c66 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:26.360030 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ae408a59-1b08-46ae-8db0-ee75ef356c66 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:26.369110 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ae408a59-1b08-46ae-8db0-ee75ef356c66 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.147607 Jul 12 13:44:26.369216 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 186/376] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:26 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:26.400324 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-04d71134-1ea7-4dcd-b477-4f5dd1810b16 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:26.401012 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-04d71134-1ea7-4dcd-b477-4f5dd1810b16 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:26.408032 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-04d71134-1ea7-4dcd-b477-4f5dd1810b16 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:26.408519 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-04d71134-1ea7-4dcd-b477-4f5dd1810b16 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:26.409299 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-04d71134-1ea7-4dcd-b477-4f5dd1810b16 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:26.409744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-04d71134-1ea7-4dcd-b477-4f5dd1810b16 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:26.474736 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-04d71134-1ea7-4dcd-b477-4f5dd1810b16 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:26.482412 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-04d71134-1ea7-4dcd-b477-4f5dd1810b16 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.085742 Jul 12 13:44:26.482908 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 191/377] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:26 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:26.518812 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bf39b43d-4c47-4387-9d1c-0b46e75660e2 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:26.519461 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bf39b43d-4c47-4387-9d1c-0b46e75660e2 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:26.525346 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf39b43d-4c47-4387-9d1c-0b46e75660e2 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:26.525800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf39b43d-4c47-4387-9d1c-0b46e75660e2 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:26.526609 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf39b43d-4c47-4387-9d1c-0b46e75660e2 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:26.527048 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf39b43d-4c47-4387-9d1c-0b46e75660e2 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:26.664528 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bf39b43d-4c47-4387-9d1c-0b46e75660e2 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:26.672893 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bf39b43d-4c47-4387-9d1c-0b46e75660e2 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.157939 Jul 12 13:44:26.673585 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 187/378] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:26 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:26.768605 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-acb4389c-fbc6-4294-8f13-b03549b0bf07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:26.769134 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-acb4389c-fbc6-4294-8f13-b03549b0bf07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:26.775667 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-acb4389c-fbc6-4294-8f13-b03549b0bf07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:26.776139 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-acb4389c-fbc6-4294-8f13-b03549b0bf07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:26.776888 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-acb4389c-fbc6-4294-8f13-b03549b0bf07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:26.777332 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-acb4389c-fbc6-4294-8f13-b03549b0bf07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:26.907431 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-acb4389c-fbc6-4294-8f13-b03549b0bf07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:26.915900 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-acb4389c-fbc6-4294-8f13-b03549b0bf07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:26.917420 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-acb4389c-fbc6-4294-8f13-b03549b0bf07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:26.918626 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-acb4389c-fbc6-4294-8f13-b03549b0bf07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.154007 Jul 12 13:44:26.919187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 192/379] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:26 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:27.004332 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a504712e-74fe-4237-8985-a48a0bc37882 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:27.004965 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a504712e-74fe-4237-8985-a48a0bc37882 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:27.010961 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a504712e-74fe-4237-8985-a48a0bc37882 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:27.011408 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a504712e-74fe-4237-8985-a48a0bc37882 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:27.012157 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a504712e-74fe-4237-8985-a48a0bc37882 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:27.012589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a504712e-74fe-4237-8985-a48a0bc37882 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:27.136606 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a504712e-74fe-4237-8985-a48a0bc37882 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:27.143853 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a504712e-74fe-4237-8985-a48a0bc37882 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.143707 Jul 12 13:44:27.144418 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 188/380] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:26 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:27.386069 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-743c98f6-7e78-4461-9659-5d9448dbd06c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:27.386682 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-743c98f6-7e78-4461-9659-5d9448dbd06c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:27.392743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-743c98f6-7e78-4461-9659-5d9448dbd06c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:27.393193 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-743c98f6-7e78-4461-9659-5d9448dbd06c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:27.393973 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-743c98f6-7e78-4461-9659-5d9448dbd06c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:27.394417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-743c98f6-7e78-4461-9659-5d9448dbd06c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:27.500110 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6d4da072-15b1-4ecc-ad71-f43d9894c8ec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:27.500729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6d4da072-15b1-4ecc-ad71-f43d9894c8ec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:27.508034 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d4da072-15b1-4ecc-ad71-f43d9894c8ec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:27.508689 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d4da072-15b1-4ecc-ad71-f43d9894c8ec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:27.509472 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d4da072-15b1-4ecc-ad71-f43d9894c8ec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:27.509914 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6d4da072-15b1-4ecc-ad71-f43d9894c8ec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:27.528984 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-743c98f6-7e78-4461-9659-5d9448dbd06c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:27.537132 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-743c98f6-7e78-4461-9659-5d9448dbd06c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.154905 Jul 12 13:44:27.537839 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 193/381] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:27 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:27.574980 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6d4da072-15b1-4ecc-ad71-f43d9894c8ec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:27.583905 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6d4da072-15b1-4ecc-ad71-f43d9894c8ec tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.086873 Jul 12 13:44:27.584599 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 189/382] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:27 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:27.690085 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bf8342ef-73eb-4497-b0ad-10a82691a913 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:27.690811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bf8342ef-73eb-4497-b0ad-10a82691a913 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:27.697318 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bf8342ef-73eb-4497-b0ad-10a82691a913 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:27.697763 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bf8342ef-73eb-4497-b0ad-10a82691a913 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:27.698562 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bf8342ef-73eb-4497-b0ad-10a82691a913 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:27.699001 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bf8342ef-73eb-4497-b0ad-10a82691a913 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:27.830026 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bf8342ef-73eb-4497-b0ad-10a82691a913 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:27.837653 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bf8342ef-73eb-4497-b0ad-10a82691a913 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.151502 Jul 12 13:44:27.838531 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 194/383] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:27 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:27.936211 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e8d93962-93b7-456d-8464-1357f99f4eec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:27.936740 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e8d93962-93b7-456d-8464-1357f99f4eec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:27.943567 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e8d93962-93b7-456d-8464-1357f99f4eec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:27.944075 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e8d93962-93b7-456d-8464-1357f99f4eec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:27.945044 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e8d93962-93b7-456d-8464-1357f99f4eec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:27.945590 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e8d93962-93b7-456d-8464-1357f99f4eec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:28.086959 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e8d93962-93b7-456d-8464-1357f99f4eec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:28.094808 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e8d93962-93b7-456d-8464-1357f99f4eec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:28.096331 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e8d93962-93b7-456d-8464-1357f99f4eec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:28.097486 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e8d93962-93b7-456d-8464-1357f99f4eec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.165285 Jul 12 13:44:28.098063 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 190/384] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:27 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:28.160673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ec292e9a-14d4-483b-94f2-004825111399 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:28.161784 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ec292e9a-14d4-483b-94f2-004825111399 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:28.168017 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec292e9a-14d4-483b-94f2-004825111399 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:28.168471 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec292e9a-14d4-483b-94f2-004825111399 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:28.169288 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec292e9a-14d4-483b-94f2-004825111399 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:28.169865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec292e9a-14d4-483b-94f2-004825111399 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:28.309874 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ec292e9a-14d4-483b-94f2-004825111399 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:28.318016 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ec292e9a-14d4-483b-94f2-004825111399 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.161082 Jul 12 13:44:28.318615 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 195/385] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:28 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:28.554667 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b7697599-015b-4628-ad16-be5ceb19b774 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:28.555180 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b7697599-015b-4628-ad16-be5ceb19b774 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:28.561690 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b7697599-015b-4628-ad16-be5ceb19b774 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:28.562175 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b7697599-015b-4628-ad16-be5ceb19b774 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:28.562937 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b7697599-015b-4628-ad16-be5ceb19b774 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:28.563374 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b7697599-015b-4628-ad16-be5ceb19b774 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:28.565860 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=100 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:28.603933 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-91084a53-ffdf-4c59-8986-65b07bf6a6f5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:28.604551 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-91084a53-ffdf-4c59-8986-65b07bf6a6f5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:28.611113 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91084a53-ffdf-4c59-8986-65b07bf6a6f5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:28.611570 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91084a53-ffdf-4c59-8986-65b07bf6a6f5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:28.612355 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91084a53-ffdf-4c59-8986-65b07bf6a6f5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:28.612798 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91084a53-ffdf-4c59-8986-65b07bf6a6f5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:28.675575 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-91084a53-ffdf-4c59-8986-65b07bf6a6f5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:28.683514 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-91084a53-ffdf-4c59-8986-65b07bf6a6f5 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.085807 Jul 12 13:44:28.684090 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 196/386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:28 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:28.695713 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b7697599-015b-4628-ad16-be5ceb19b774 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:28.704096 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b7697599-015b-4628-ad16-be5ceb19b774 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.153350 Jul 12 13:44:28.704833 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 191/387] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:28 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:28.854427 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ec8afc3b-c0e3-4524-beeb-b05f89b6e480 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:28.855041 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ec8afc3b-c0e3-4524-beeb-b05f89b6e480 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:28.861068 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec8afc3b-c0e3-4524-beeb-b05f89b6e480 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:28.861520 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec8afc3b-c0e3-4524-beeb-b05f89b6e480 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:28.862318 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec8afc3b-c0e3-4524-beeb-b05f89b6e480 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:28.862768 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ec8afc3b-c0e3-4524-beeb-b05f89b6e480 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:28.994527 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ec8afc3b-c0e3-4524-beeb-b05f89b6e480 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:29.002285 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ec8afc3b-c0e3-4524-beeb-b05f89b6e480 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.151387 Jul 12 13:44:29.002854 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 197/388] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:28 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:29.116490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-13547e6d-8128-4fac-98e2-c395c367bf05 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:29.117099 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-13547e6d-8128-4fac-98e2-c395c367bf05 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:29.123164 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-13547e6d-8128-4fac-98e2-c395c367bf05 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:29.123618 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-13547e6d-8128-4fac-98e2-c395c367bf05 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:29.124378 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-13547e6d-8128-4fac-98e2-c395c367bf05 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:29.124822 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-13547e6d-8128-4fac-98e2-c395c367bf05 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:29.249257 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-13547e6d-8128-4fac-98e2-c395c367bf05 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:29.258046 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-13547e6d-8128-4fac-98e2-c395c367bf05 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:29.259571 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-13547e6d-8128-4fac-98e2-c395c367bf05 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:29.260727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-13547e6d-8128-4fac-98e2-c395c367bf05 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.148623 Jul 12 13:44:29.261287 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 192/389] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:29 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:29.335507 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6603da0d-e6f8-4477-af44-c783a09bc9e4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:29.336115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6603da0d-e6f8-4477-af44-c783a09bc9e4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:29.342135 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6603da0d-e6f8-4477-af44-c783a09bc9e4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:29.342589 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6603da0d-e6f8-4477-af44-c783a09bc9e4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:29.343355 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6603da0d-e6f8-4477-af44-c783a09bc9e4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:29.343798 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6603da0d-e6f8-4477-af44-c783a09bc9e4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:29.468361 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6603da0d-e6f8-4477-af44-c783a09bc9e4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:29.476191 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6603da0d-e6f8-4477-af44-c783a09bc9e4 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.144563 Jul 12 13:44:29.476761 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 198/390] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:29 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:29.700779 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-9355e9fa-fdd8-46f0-adc4-0580b4c429d1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:29.702016 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-9355e9fa-fdd8-46f0-adc4-0580b4c429d1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:29.708692 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9355e9fa-fdd8-46f0-adc4-0580b4c429d1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:29.709146 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9355e9fa-fdd8-46f0-adc4-0580b4c429d1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:29.709915 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9355e9fa-fdd8-46f0-adc4-0580b4c429d1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:29.710378 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9355e9fa-fdd8-46f0-adc4-0580b4c429d1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:29.721633 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8c4dd927-d81b-4d8f-94b8-ad6a4497b507 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:29.722283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8c4dd927-d81b-4d8f-94b8-ad6a4497b507 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:29.729246 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8c4dd927-d81b-4d8f-94b8-ad6a4497b507 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:29.729700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8c4dd927-d81b-4d8f-94b8-ad6a4497b507 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:29.730535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8c4dd927-d81b-4d8f-94b8-ad6a4497b507 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:29.730977 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8c4dd927-d81b-4d8f-94b8-ad6a4497b507 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:29.778009 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-9355e9fa-fdd8-46f0-adc4-0580b4c429d1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:29.786682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-9355e9fa-fdd8-46f0-adc4-0580b4c429d1 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.089232 Jul 12 13:44:29.787456 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 193/391] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:29 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:29.868303 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8c4dd927-d81b-4d8f-94b8-ad6a4497b507 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:29.876316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8c4dd927-d81b-4d8f-94b8-ad6a4497b507 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.158526 Jul 12 13:44:29.877140 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 199/392] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:29 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:30.019400 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3f5019d1-5604-48b8-8469-20ce1b5f8c09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:30.019932 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3f5019d1-5604-48b8-8469-20ce1b5f8c09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:30.026439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f5019d1-5604-48b8-8469-20ce1b5f8c09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:30.026884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f5019d1-5604-48b8-8469-20ce1b5f8c09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:30.027632 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f5019d1-5604-48b8-8469-20ce1b5f8c09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:30.028061 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f5019d1-5604-48b8-8469-20ce1b5f8c09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:30.156972 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3f5019d1-5604-48b8-8469-20ce1b5f8c09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:30.165016 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3f5019d1-5604-48b8-8469-20ce1b5f8c09 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.149532 Jul 12 13:44:30.165583 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 194/393] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:30 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:30.278778 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-75f17bec-e98a-44ba-a470-abacc176115b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:30.279432 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-75f17bec-e98a-44ba-a470-abacc176115b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:30.285395 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-75f17bec-e98a-44ba-a470-abacc176115b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:30.285845 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-75f17bec-e98a-44ba-a470-abacc176115b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:30.286635 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-75f17bec-e98a-44ba-a470-abacc176115b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:30.287071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-75f17bec-e98a-44ba-a470-abacc176115b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:30.413388 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-75f17bec-e98a-44ba-a470-abacc176115b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:30.421262 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-75f17bec-e98a-44ba-a470-abacc176115b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:30.422817 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-75f17bec-e98a-44ba-a470-abacc176115b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:30.423976 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-75f17bec-e98a-44ba-a470-abacc176115b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.149227 Jul 12 13:44:30.424535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 200/394] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:30 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:30.492478 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-59637328-6e7c-49f1-8085-d9c1497f4546 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:30.493087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-59637328-6e7c-49f1-8085-d9c1497f4546 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:30.499084 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-59637328-6e7c-49f1-8085-d9c1497f4546 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:30.499538 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-59637328-6e7c-49f1-8085-d9c1497f4546 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:30.500303 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-59637328-6e7c-49f1-8085-d9c1497f4546 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:30.500741 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-59637328-6e7c-49f1-8085-d9c1497f4546 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:30.630572 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-59637328-6e7c-49f1-8085-d9c1497f4546 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:30.638180 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-59637328-6e7c-49f1-8085-d9c1497f4546 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.149536 Jul 12 13:44:30.638751 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 195/395] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:30 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:30.804021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ae7c9877-8d02-43e9-844c-2a05e8424a57 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:30.804580 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ae7c9877-8d02-43e9-844c-2a05e8424a57 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:30.811068 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ae7c9877-8d02-43e9-844c-2a05e8424a57 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:30.811524 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ae7c9877-8d02-43e9-844c-2a05e8424a57 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:30.812294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ae7c9877-8d02-43e9-844c-2a05e8424a57 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:30.812737 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ae7c9877-8d02-43e9-844c-2a05e8424a57 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:30.877275 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ae7c9877-8d02-43e9-844c-2a05e8424a57 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:30.885387 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ae7c9877-8d02-43e9-844c-2a05e8424a57 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.085694 Jul 12 13:44:30.885950 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 201/396] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:30 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:30.893406 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b62fd912-4ab4-4782-93d7-e23d119141b3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:30.894153 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b62fd912-4ab4-4782-93d7-e23d119141b3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:30.900595 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b62fd912-4ab4-4782-93d7-e23d119141b3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:30.901050 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b62fd912-4ab4-4782-93d7-e23d119141b3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:30.901845 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b62fd912-4ab4-4782-93d7-e23d119141b3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:30.902318 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b62fd912-4ab4-4782-93d7-e23d119141b3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:31.028955 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b62fd912-4ab4-4782-93d7-e23d119141b3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:31.037364 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b62fd912-4ab4-4782-93d7-e23d119141b3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.147788 Jul 12 13:44:31.037919 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 196/397] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:30 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:31.181626 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-39fc6675-05a9-49a4-b4ec-17ca4234043e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:31.182263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-39fc6675-05a9-49a4-b4ec-17ca4234043e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:31.188277 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-39fc6675-05a9-49a4-b4ec-17ca4234043e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:31.188720 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-39fc6675-05a9-49a4-b4ec-17ca4234043e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:31.189468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-39fc6675-05a9-49a4-b4ec-17ca4234043e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:31.189895 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-39fc6675-05a9-49a4-b4ec-17ca4234043e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:31.321692 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-39fc6675-05a9-49a4-b4ec-17ca4234043e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:31.328977 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-39fc6675-05a9-49a4-b4ec-17ca4234043e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.151153 Jul 12 13:44:31.329534 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 202/398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:31 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:31.441116 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-249773f3-1e75-40f8-bbde-4fc5cd8a45a9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:31.441732 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-249773f3-1e75-40f8-bbde-4fc5cd8a45a9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:31.447750 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-249773f3-1e75-40f8-bbde-4fc5cd8a45a9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:31.448202 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-249773f3-1e75-40f8-bbde-4fc5cd8a45a9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:31.448998 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-249773f3-1e75-40f8-bbde-4fc5cd8a45a9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:31.449436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-249773f3-1e75-40f8-bbde-4fc5cd8a45a9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:31.577520 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-249773f3-1e75-40f8-bbde-4fc5cd8a45a9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:31.586799 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-249773f3-1e75-40f8-bbde-4fc5cd8a45a9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:31.588358 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-249773f3-1e75-40f8-bbde-4fc5cd8a45a9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:31.589547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-249773f3-1e75-40f8-bbde-4fc5cd8a45a9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.152288 Jul 12 13:44:31.590132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 197/399] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:31 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:31.654656 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b0d774b8-7b2c-49f7-84dc-e050ca7a1808 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:31.655269 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b0d774b8-7b2c-49f7-84dc-e050ca7a1808 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:31.661867 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0d774b8-7b2c-49f7-84dc-e050ca7a1808 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:31.662349 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0d774b8-7b2c-49f7-84dc-e050ca7a1808 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:31.663117 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0d774b8-7b2c-49f7-84dc-e050ca7a1808 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:31.663558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b0d774b8-7b2c-49f7-84dc-e050ca7a1808 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:31.788497 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b0d774b8-7b2c-49f7-84dc-e050ca7a1808 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:31.795846 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b0d774b8-7b2c-49f7-84dc-e050ca7a1808 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.144999 Jul 12 13:44:31.796414 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 203/400] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:31 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:31.902208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-11838b9e-2ec0-4d5d-8146-75bb55aac94f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:31.902848 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-11838b9e-2ec0-4d5d-8146-75bb55aac94f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:31.909262 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-11838b9e-2ec0-4d5d-8146-75bb55aac94f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:31.909832 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-11838b9e-2ec0-4d5d-8146-75bb55aac94f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:31.910638 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-11838b9e-2ec0-4d5d-8146-75bb55aac94f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:31.911078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-11838b9e-2ec0-4d5d-8146-75bb55aac94f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:31.971964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-11838b9e-2ec0-4d5d-8146-75bb55aac94f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:31.979553 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-11838b9e-2ec0-4d5d-8146-75bb55aac94f tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1460 microversion: 2.1 time: 0.081167 Jul 12 13:44:31.980126 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 198/401] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:31 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1460 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:32.054181 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f02720fb-3468-42d4-9fc5-eec0bfd4347d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:32.054795 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f02720fb-3468-42d4-9fc5-eec0bfd4347d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:32.061513 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f02720fb-3468-42d4-9fc5-eec0bfd4347d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:32.061981 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f02720fb-3468-42d4-9fc5-eec0bfd4347d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:32.062765 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f02720fb-3468-42d4-9fc5-eec0bfd4347d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:32.063239 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f02720fb-3468-42d4-9fc5-eec0bfd4347d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:32.191650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f02720fb-3468-42d4-9fc5-eec0bfd4347d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:32.200449 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f02720fb-3468-42d4-9fc5-eec0bfd4347d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.150139 Jul 12 13:44:32.201018 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 204/402] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:32 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:32.345463 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1ae2529b-1bbc-4c86-9fbc-56f6d779ea20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:32.346121 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1ae2529b-1bbc-4c86-9fbc-56f6d779ea20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:32.347966 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:32.353378 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ae2529b-1bbc-4c86-9fbc-56f6d779ea20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:32.353828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ae2529b-1bbc-4c86-9fbc-56f6d779ea20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:32.354627 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ae2529b-1bbc-4c86-9fbc-56f6d779ea20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:32.355070 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ae2529b-1bbc-4c86-9fbc-56f6d779ea20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:32.484928 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1ae2529b-1bbc-4c86-9fbc-56f6d779ea20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:32.493094 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1ae2529b-1bbc-4c86-9fbc-56f6d779ea20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1264 microversion: 2.1 time: 0.151494 Jul 12 13:44:32.493700 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 199/403] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:32 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:32.607831 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a84d93e4-8069-40bd-91c3-c4c7752342d5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:32.608434 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a84d93e4-8069-40bd-91c3-c4c7752342d5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:32.615086 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a84d93e4-8069-40bd-91c3-c4c7752342d5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:32.615526 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a84d93e4-8069-40bd-91c3-c4c7752342d5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:32.616287 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a84d93e4-8069-40bd-91c3-c4c7752342d5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:32.616723 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a84d93e4-8069-40bd-91c3-c4c7752342d5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:32.634771 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:32.746671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a84d93e4-8069-40bd-91c3-c4c7752342d5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:32.755258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a84d93e4-8069-40bd-91c3-c4c7752342d5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:32.756776 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a84d93e4-8069-40bd-91c3-c4c7752342d5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:32.757980 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a84d93e4-8069-40bd-91c3-c4c7752342d5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.154017 Jul 12 13:44:32.758550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 205/404] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:32 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:32.812005 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f84447bc-9e50-4fb1-b518-ee1d788da758 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:32.812745 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f84447bc-9e50-4fb1-b518-ee1d788da758 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:32.819154 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f84447bc-9e50-4fb1-b518-ee1d788da758 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:32.819642 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f84447bc-9e50-4fb1-b518-ee1d788da758 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:32.820405 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f84447bc-9e50-4fb1-b518-ee1d788da758 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:32.820845 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f84447bc-9e50-4fb1-b518-ee1d788da758 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:32.951798 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f84447bc-9e50-4fb1-b518-ee1d788da758 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:32.959936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f84447bc-9e50-4fb1-b518-ee1d788da758 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.151897 Jul 12 13:44:32.960512 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 200/405] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:32 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:32.995776 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-72ccd827-7607-4e8a-b326-ae0d08ab4842 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:32.996375 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-72ccd827-7607-4e8a-b326-ae0d08ab4842 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:33.002630 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-72ccd827-7607-4e8a-b326-ae0d08ab4842 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.003070 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-72ccd827-7607-4e8a-b326-ae0d08ab4842 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.003847 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-72ccd827-7607-4e8a-b326-ae0d08ab4842 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.004276 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-72ccd827-7607-4e8a-b326-ae0d08ab4842 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.068077 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-72ccd827-7607-4e8a-b326-ae0d08ab4842 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:33.075911 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-72ccd827-7607-4e8a-b326-ae0d08ab4842 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1298 microversion: 2.1 time: 0.083877 Jul 12 13:44:33.076819 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 206/406] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:32 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:33.216701 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6daf276c-36c3-4ff9-bc43-7609c80d5084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:33.217244 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6daf276c-36c3-4ff9-bc43-7609c80d5084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:33.224884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6daf276c-36c3-4ff9-bc43-7609c80d5084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.225368 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6daf276c-36c3-4ff9-bc43-7609c80d5084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.226505 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6daf276c-36c3-4ff9-bc43-7609c80d5084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.226952 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6daf276c-36c3-4ff9-bc43-7609c80d5084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.356528 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6daf276c-36c3-4ff9-bc43-7609c80d5084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:33.364498 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6daf276c-36c3-4ff9-bc43-7609c80d5084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.151751 Jul 12 13:44:33.365065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 201/407] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:33 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:33.510707 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bc8ac06f-2f43-4718-9b2d-a22d23d9de20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:33.511251 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bc8ac06f-2f43-4718-9b2d-a22d23d9de20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:33.517249 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc8ac06f-2f43-4718-9b2d-a22d23d9de20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.517704 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc8ac06f-2f43-4718-9b2d-a22d23d9de20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.518491 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc8ac06f-2f43-4718-9b2d-a22d23d9de20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.518937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bc8ac06f-2f43-4718-9b2d-a22d23d9de20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.651560 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bc8ac06f-2f43-4718-9b2d-a22d23d9de20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:33.658908 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bc8ac06f-2f43-4718-9b2d-a22d23d9de20 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1449 microversion: 2.1 time: 0.152194 Jul 12 13:44:33.659460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 207/408] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:33 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:33.675146 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-cc117fff-0e38-49ee-bb68-fd7dfab1013e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:33.675763 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-cc117fff-0e38-49ee-bb68-fd7dfab1013e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:33.682288 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cc117fff-0e38-49ee-bb68-fd7dfab1013e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.682738 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cc117fff-0e38-49ee-bb68-fd7dfab1013e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.683503 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cc117fff-0e38-49ee-bb68-fd7dfab1013e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.683946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cc117fff-0e38-49ee-bb68-fd7dfab1013e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.776538 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cc245ebe-990e-4acf-b529-80a4fe9ebec5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:33.777333 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cc245ebe-990e-4acf-b529-80a4fe9ebec5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:33.784290 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc245ebe-990e-4acf-b529-80a4fe9ebec5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.784910 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc245ebe-990e-4acf-b529-80a4fe9ebec5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.785856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc245ebe-990e-4acf-b529-80a4fe9ebec5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.786415 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cc245ebe-990e-4acf-b529-80a4fe9ebec5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.890594 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-cc117fff-0e38-49ee-bb68-fd7dfab1013e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:33.898498 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-cc117fff-0e38-49ee-bb68-fd7dfab1013e tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1449 microversion: 2.1 time: 0.226946 Jul 12 13:44:33.899375 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 202/409] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:33 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1449 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:33.922379 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cc245ebe-990e-4acf-b529-80a4fe9ebec5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:33.930897 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cc245ebe-990e-4acf-b529-80a4fe9ebec5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:33.932416 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cc245ebe-990e-4acf-b529-80a4fe9ebec5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:33.933578 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cc245ebe-990e-4acf-b529-80a4fe9ebec5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1744 microversion: 2.20 time: 0.161358 Jul 12 13:44:33.934168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 208/410] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:33 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:44:33.976996 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-073d2dcb-935e-4211-b7e3-b290a5f8f1d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:33.977993 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-073d2dcb-935e-4211-b7e3-b290a5f8f1d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:33.985608 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-073d2dcb-935e-4211-b7e3-b290a5f8f1d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.986091 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-073d2dcb-935e-4211-b7e3-b290a5f8f1d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:33.986854 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-073d2dcb-935e-4211-b7e3-b290a5f8f1d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:33.987619 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-073d2dcb-935e-4211-b7e3-b290a5f8f1d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:34.093768 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:34.094597 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:34.101571 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:34.102064 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:34.102837 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:34.103285 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:34.136551 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:34.137009 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:34.137546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lazy-loading 'fault' on Instance uuid 6dc4f645-5c2b-4346-b730-0dff41046431 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:44:34.151561 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-073d2dcb-935e-4211-b7e3-b290a5f8f1d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:34.159301 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-073d2dcb-935e-4211-b7e3-b290a5f8f1d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.186587 Jul 12 13:44:34.159961 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 203/411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:33 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:34.191688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:34.199193 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-85f54343-296c-4094-8b26-49a1ec52d30d tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1303 microversion: 2.1 time: 0.109294 Jul 12 13:44:34.199765 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 209/412] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:34 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:34.380977 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-2663f69f-ae89-46ab-93f3-483a4bd94742 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:34.381743 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-2663f69f-ae89-46ab-93f3-483a4bd94742 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:34.387923 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2663f69f-ae89-46ab-93f3-483a4bd94742 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:34.388558 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2663f69f-ae89-46ab-93f3-483a4bd94742 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:34.389422 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2663f69f-ae89-46ab-93f3-483a4bd94742 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:34.390020 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2663f69f-ae89-46ab-93f3-483a4bd94742 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:34.518490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-2663f69f-ae89-46ab-93f3-483a4bd94742 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:34.543453 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-2663f69f-ae89-46ab-93f3-483a4bd94742 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.166614 Jul 12 13:44:34.544177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 204/413] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:34 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:34.952649 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-779bed4c-3e33-4457-aff7-7d1a42b30c0f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:34.953347 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-779bed4c-3e33-4457-aff7-7d1a42b30c0f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:34.960171 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-779bed4c-3e33-4457-aff7-7d1a42b30c0f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:34.960664 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-779bed4c-3e33-4457-aff7-7d1a42b30c0f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:34.961688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-779bed4c-3e33-4457-aff7-7d1a42b30c0f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:34.962162 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-779bed4c-3e33-4457-aff7-7d1a42b30c0f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:35.177178 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-fe1c912e-7a1e-4330-aa45-90ba3f619f27 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:35.177801 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-fe1c912e-7a1e-4330-aa45-90ba3f619f27 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:35.180822 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-779bed4c-3e33-4457-aff7-7d1a42b30c0f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:35.185014 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fe1c912e-7a1e-4330-aa45-90ba3f619f27 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:35.185475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fe1c912e-7a1e-4330-aa45-90ba3f619f27 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:35.186279 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fe1c912e-7a1e-4330-aa45-90ba3f619f27 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:35.186935 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fe1c912e-7a1e-4330-aa45-90ba3f619f27 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:35.190121 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-779bed4c-3e33-4457-aff7-7d1a42b30c0f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:35.191723 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-779bed4c-3e33-4457-aff7-7d1a42b30c0f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:35.193528 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-779bed4c-3e33-4457-aff7-7d1a42b30c0f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1744 microversion: 2.20 time: 0.244793 Jul 12 13:44:35.194105 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 210/414] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:34 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1744 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:35.216474 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:35.217089 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:35.223185 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:35.223673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:35.224408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:35.224848 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:35.257557 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:35.258072 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:35.258526 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lazy-loading 'fault' on Instance uuid 6dc4f645-5c2b-4346-b730-0dff41046431 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:44:35.327103 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-fe1c912e-7a1e-4330-aa45-90ba3f619f27 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:35.334744 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-fe1c912e-7a1e-4330-aa45-90ba3f619f27 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.161874 Jul 12 13:44:35.342817 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '287144c6346a43d09cdbae463ca9a961', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3ab1e8d5fd4ac7b34c60a4a3cf9c45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:35.344168 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 205/415] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:35 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:35.351587 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4ce58358-f9fe-489a-9ff5-592195bfbe7a tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 200 len: 1303 microversion: 2.1 time: 0.138826 Jul 12 13:44:35.352155 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 211/416] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:35 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:35.561326 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-dbc8f7db-ec62-40e6-b34a-c646db3ecef2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:35.562072 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-dbc8f7db-ec62-40e6-b34a-c646db3ecef2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:35.568284 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dbc8f7db-ec62-40e6-b34a-c646db3ecef2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:35.568816 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dbc8f7db-ec62-40e6-b34a-c646db3ecef2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:35.569666 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dbc8f7db-ec62-40e6-b34a-c646db3ecef2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:35.570233 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dbc8f7db-ec62-40e6-b34a-c646db3ecef2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:35.718323 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-dbc8f7db-ec62-40e6-b34a-c646db3ecef2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:35.727460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-dbc8f7db-ec62-40e6-b34a-c646db3ecef2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.170030 Jul 12 13:44:35.728280 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 206/417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:35 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:35.823590 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-ace737f4-38b5-48ea-84ee-6bc9c75e0e57 req-153f2ed0-8bbe-45a1-b657-86cb7c8f6422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c496f49-2bd0-4b55-bca1-6402b331e1a1", "tag": "dd8d0273-59e6-4628-b80c-fb8d75a315d0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:35.831810 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ace737f4-38b5-48ea-84ee-6bc9c75e0e57 req-153f2ed0-8bbe-45a1-b657-86cb7c8f6422 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:35.832321 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ace737f4-38b5-48ea-84ee-6bc9c75e0e57 req-153f2ed0-8bbe-45a1-b657-86cb7c8f6422 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:35.842982 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-ace737f4-38b5-48ea-84ee-6bc9c75e0e57 req-153f2ed0-8bbe-45a1-b657-86cb7c8f6422 service nova] Creating event network-changed:dd8d0273-59e6-4628-b80c-fb8d75a315d0 for instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 on hv-cinder-79797 Jul 12 13:44:35.848068 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-ace737f4-38b5-48ea-84ee-6bc9c75e0e57 req-153f2ed0-8bbe-45a1-b657-86cb7c8f6422 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028158 Jul 12 13:44:35.849874 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 212/418] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:36.202250 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-35919649-7ba7-4e0b-87cd-b9ffb5931ff9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: .version_select at 0x7f3a160b2700>, body: {"keypair": {"name": "tempest-keypair-1228198703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeGCiRNH2xwr5Te1smsNq0ZejrWBF4QlFYGvsgk1rDnUKljEOlWBMKh5XewxwGlTYr0gSq0Kp5lQPk6TvenXKNgd6ntT/7Y1mIOMBZeKsiaSG7lUX5/tcm75yFT7kCw/A=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:36.212190 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aeefbdd9-cf96-439b-b8b9-031a11add9ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:36.213436 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aeefbdd9-cf96-439b-b8b9-031a11add9ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:36.229939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-35919649-7ba7-4e0b-87cd-b9ffb5931ff9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for project c4e88457b140443093476f9b6d9bcff4. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:44:36.230460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aeefbdd9-cf96-439b-b8b9-031a11add9ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:36.231138 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aeefbdd9-cf96-439b-b8b9-031a11add9ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:36.232114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aeefbdd9-cf96-439b-b8b9-031a11add9ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:36.232773 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aeefbdd9-cf96-439b-b8b9-031a11add9ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:36.236452 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-35919649-7ba7-4e0b-87cd-b9ffb5931ff9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for user a892b2511463404c818c63e870a23389 and project c4e88457b140443093476f9b6d9bcff4. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:44:36.268360 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-35919649-7ba7-4e0b-87cd-b9ffb5931ff9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070520 Jul 12 13:44:36.269435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 207/419] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jul 12 13:44:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:44:36.355224 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-db8883f5-633c-4065-bfa5-717dfb85a688 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:36.355933 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-db8883f5-633c-4065-bfa5-717dfb85a688 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:36.365521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-db8883f5-633c-4065-bfa5-717dfb85a688 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:36.365983 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-db8883f5-633c-4065-bfa5-717dfb85a688 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:36.366783 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-db8883f5-633c-4065-bfa5-717dfb85a688 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:36.367218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-db8883f5-633c-4065-bfa5-717dfb85a688 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:36.483304 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aeefbdd9-cf96-439b-b8b9-031a11add9ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:36.494451 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aeefbdd9-cf96-439b-b8b9-031a11add9ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:36.498442 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aeefbdd9-cf96-439b-b8b9-031a11add9ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:36.500582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aeefbdd9-cf96-439b-b8b9-031a11add9ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1744 microversion: 2.20 time: 0.293458 Jul 12 13:44:36.502469 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 213/420] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:36 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1744 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:44:36.509985 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-752bfcb0-22ab-4cc1-a56d-a385f7f18625 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:36.511336 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-752bfcb0-22ab-4cc1-a56d-a385f7f18625 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] [instance: 6dc4f645-5c2b-4346-b730-0dff41046431] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:36.542613 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-752bfcb0-22ab-4cc1-a56d-a385f7f18625 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:36.543493 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-752bfcb0-22ab-4cc1-a56d-a385f7f18625 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:36.545624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-752bfcb0-22ab-4cc1-a56d-a385f7f18625 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:36.546938 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-752bfcb0-22ab-4cc1-a56d-a385f7f18625 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:36.570625 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-752bfcb0-22ab-4cc1-a56d-a385f7f18625 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] HTTP exception thrown: Instance 6dc4f645-5c2b-4346-b730-0dff41046431 could not be found. Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-752bfcb0-22ab-4cc1-a56d-a385f7f18625 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Request method failure captured: Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 HTTP/1.1 Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXqD4uW_BoEEVHDM0cg-fWozYoFKIMQPbu4mvCm1Y4o-KWYIcTWFWbpU6h-lyiXxEMJ1vwb7yMSiUePALkYW9lYv4HfOkg_1cj--UmNslhax5LpMtLug8RDi1REFYSGt4y0pZ2LiElZLy4Cnbr4RxBLO-f9QNGa2cm_TSjLdHjk1jwI Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 4f3ab1e8d5fd4ac7b34c60a4a3cf9c45 Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesActionsTest-390629507 Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:44:36.573885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f3ab1e8d5fd4ac7b34c60a4a3cf9c45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f3ab1e8d5fd4ac7b34c60a4a3cf9c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f3ab1e8d5fd4ac7b34c60a4a3cf9c45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f3ab1e8d5fd4ac7b34c60a4a3cf9c45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesActionsTest-390629507 Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 4f3ab1e8d5fd4ac7b34c60a4a3cf9c45 Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesActionsTest-390629507 Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesActionsTest-390629507-project Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: 287144c6346a43d09cdbae463ca9a961 Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesActionsTest-390629507-project Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 6dc4f645-5c2b-4346-b730-0dff41046431 could not be found. Jul 12 13:44:36.575233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '6dc4f645-5c2b-4346-b730-0dff41046431'} Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc4f645-5c2b-4346-b730-0dff41046431 could not be found. Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:44:36.575996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc4f645-5c2b-4346-b730-0dff41046431 could not be found. Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc4f645-5c2b-4346-b730-0dff41046431 could not be found. Jul 12 13:44:36.577173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:44:36.579499 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-752bfcb0-22ab-4cc1-a56d-a385f7f18625 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] Returning 404 to user: Instance 6dc4f645-5c2b-4346-b730-0dff41046431 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:44:36.580484 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-752bfcb0-22ab-4cc1-a56d-a385f7f18625 tempest-VolumesActionsTest-390629507 tempest-VolumesActionsTest-390629507-project] 10.222.0.52 "GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431" status: 404 len: 111 microversion: 2.1 time: 0.076639 Jul 12 13:44:36.586853 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 214/421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:36 2022] GET /compute/v2.1/servers/6dc4f645-5c2b-4346-b730-0dff41046431 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:44:36.745135 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4861840f-8ce0-4c9e-976f-34da9ea1ea4b tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:36.745759 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4861840f-8ce0-4c9e-976f-34da9ea1ea4b tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:36.753854 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4861840f-8ce0-4c9e-976f-34da9ea1ea4b tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:36.754485 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4861840f-8ce0-4c9e-976f-34da9ea1ea4b tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:36.755756 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4861840f-8ce0-4c9e-976f-34da9ea1ea4b tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:36.756205 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4861840f-8ce0-4c9e-976f-34da9ea1ea4b tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:36.958841 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-db8883f5-633c-4065-bfa5-717dfb85a688 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:36.961825 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=100 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:36.972853 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-db8883f5-633c-4065-bfa5-717dfb85a688 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.624860 Jul 12 13:44:36.985829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 208/422] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:36 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:37.038126 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4861840f-8ce0-4c9e-976f-34da9ea1ea4b tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:37.047551 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4861840f-8ce0-4c9e-976f-34da9ea1ea4b tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.306200 Jul 12 13:44:37.049015 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 215/423] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:36 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:37.521250 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-2555d5ec-1faa-44ae-b6dc-2447dab67be6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:37.522066 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-2555d5ec-1faa-44ae-b6dc-2447dab67be6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:37.533687 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2555d5ec-1faa-44ae-b6dc-2447dab67be6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:37.534206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2555d5ec-1faa-44ae-b6dc-2447dab67be6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:37.534986 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2555d5ec-1faa-44ae-b6dc-2447dab67be6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:37.535640 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2555d5ec-1faa-44ae-b6dc-2447dab67be6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:37.681220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-83af46c8-565c-45b0-b6ef-4c95596d05ed req-5e74a537-61a0-48be-b9a2-26d40239deb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d01af-d429-48d6-9f16-6255557bdb67", "name": "network-vif-plugged", "status": "completed", "tag": "35051ab0-4751-427b-ae9e-ddc1611523c0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:37.697027 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-2555d5ec-1faa-44ae-b6dc-2447dab67be6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:37.700929 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-83af46c8-565c-45b0-b6ef-4c95596d05ed req-5e74a537-61a0-48be-b9a2-26d40239deb5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:37.704915 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-83af46c8-565c-45b0-b6ef-4c95596d05ed req-5e74a537-61a0-48be-b9a2-26d40239deb5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:37.721765 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-2555d5ec-1faa-44ae-b6dc-2447dab67be6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:37.723852 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-2555d5ec-1faa-44ae-b6dc-2447dab67be6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:37.725293 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-2555d5ec-1faa-44ae-b6dc-2447dab67be6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1744 microversion: 2.20 time: 0.208864 Jul 12 13:44:37.725852 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 209/424] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:37 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1744 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:44:37.727515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-83af46c8-565c-45b0-b6ef-4c95596d05ed req-5e74a537-61a0-48be-b9a2-26d40239deb5 service nova] Creating event network-vif-plugged:35051ab0-4751-427b-ae9e-ddc1611523c0 for instance e71d01af-d429-48d6-9f16-6255557bdb67 on hv-cinder-79797 Jul 12 13:44:37.739794 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-83af46c8-565c-45b0-b6ef-4c95596d05ed req-5e74a537-61a0-48be-b9a2-26d40239deb5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062998 Jul 12 13:44:37.740926 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 216/425] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:37.973823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1053993029", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0de195dd-d448-4ed3-8684-a2fd07757acb"}], "security_groups": [{"name": "tempest-securitygroup--810460073"}], "key_name": "tempest-keypair-1228198703", "user_data": "}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:37.992616 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c6410e37-ec2b-4aa9-a17d-d319cbd329ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:37.993541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c6410e37-ec2b-4aa9-a17d-d319cbd329ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:38.000435 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c6410e37-ec2b-4aa9-a17d-d319cbd329ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:38.000900 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c6410e37-ec2b-4aa9-a17d-d319cbd329ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:38.002053 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c6410e37-ec2b-4aa9-a17d-d319cbd329ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:38.002599 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c6410e37-ec2b-4aa9-a17d-d319cbd329ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:38.078617 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.network.neutron [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] validate_networks() for [('0de195dd-d448-4ed3-8684-a2fd07757acb', None, None, None, None, None)] {{(pid=124465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:44:38.135449 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c6410e37-ec2b-4aa9-a17d-d319cbd329ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:38.143145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c6410e37-ec2b-4aa9-a17d-d319cbd329ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.155644 Jul 12 13:44:38.143708 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 217/426] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:37 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:38.148673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fe95858a-f5bc-4955-9475-e485cc0f9edd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:38.149277 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fe95858a-f5bc-4955-9475-e485cc0f9edd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:38.155536 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe95858a-f5bc-4955-9475-e485cc0f9edd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:38.155991 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe95858a-f5bc-4955-9475-e485cc0f9edd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:38.156773 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe95858a-f5bc-4955-9475-e485cc0f9edd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:38.157219 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fe95858a-f5bc-4955-9475-e485cc0f9edd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:38.287850 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fe95858a-f5bc-4955-9475-e485cc0f9edd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:38.295657 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fe95858a-f5bc-4955-9475-e485cc0f9edd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.151009 Jul 12 13:44:38.296213 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 218/427] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:38 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:38.447960 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Flavor limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:44:38.448389 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Image limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:44:38.448866 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Flavor pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:44:38.449281 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Image pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:44:38.449699 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:44:38.459166 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:38.459608 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:38.460437 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:38.460910 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:38.478460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for project c4e88457b140443093476f9b6d9bcff4. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:44:38.482338 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for user a892b2511463404c818c63e870a23389 and project c4e88457b140443093476f9b6d9bcff4. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:44:38.493320 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Going to run 1 instances... {{(pid=124465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:44:38.495546 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:44:38.542919 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f8aeefe5-5795-4e25-b124-ac87911e9994 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.574036 Jul 12 13:44:38.543806 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 210/428] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:44:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:44:38.553835 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-403a74eb-d668-4163-8f2c-ce192fc9e702 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:38.554562 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-403a74eb-d668-4163-8f2c-ce192fc9e702 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:38.614364 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-403a74eb-d668-4163-8f2c-ce192fc9e702 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:38.620983 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-403a74eb-d668-4163-8f2c-ce192fc9e702 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1242 microversion: 2.1 time: 0.071509 Jul 12 13:44:38.621539 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 219/429] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:38 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:38.743550 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f9c37510-5baa-4bbd-8337-fefdf9129322 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:38.744282 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f9c37510-5baa-4bbd-8337-fefdf9129322 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:38.750485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f9c37510-5baa-4bbd-8337-fefdf9129322 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:38.751007 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f9c37510-5baa-4bbd-8337-fefdf9129322 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:38.752268 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f9c37510-5baa-4bbd-8337-fefdf9129322 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:38.752511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f9c37510-5baa-4bbd-8337-fefdf9129322 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:38.891834 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f9c37510-5baa-4bbd-8337-fefdf9129322 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:38.900106 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f9c37510-5baa-4bbd-8337-fefdf9129322 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:38.901651 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f9c37510-5baa-4bbd-8337-fefdf9129322 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:38.902817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f9c37510-5baa-4bbd-8337-fefdf9129322 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1744 microversion: 2.20 time: 0.163591 Jul 12 13:44:38.903368 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 211/430] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:38 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:39.159621 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-206009bf-050a-4b27-82d4-c42865f37e6b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:39.160234 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-206009bf-050a-4b27-82d4-c42865f37e6b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:39.162697 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:39.169002 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-206009bf-050a-4b27-82d4-c42865f37e6b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:39.169456 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-206009bf-050a-4b27-82d4-c42865f37e6b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:39.170258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-206009bf-050a-4b27-82d4-c42865f37e6b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:39.170701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-206009bf-050a-4b27-82d4-c42865f37e6b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:39.297441 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-206009bf-050a-4b27-82d4-c42865f37e6b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:39.305517 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-206009bf-050a-4b27-82d4-c42865f37e6b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.149743 Jul 12 13:44:39.306297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 220/431] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:39 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:39.311704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d004117c-2a1d-4acc-8a07-58fd00a96293 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:39.312314 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d004117c-2a1d-4acc-8a07-58fd00a96293 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:39.318373 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d004117c-2a1d-4acc-8a07-58fd00a96293 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:39.318824 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d004117c-2a1d-4acc-8a07-58fd00a96293 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:39.319583 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d004117c-2a1d-4acc-8a07-58fd00a96293 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:39.320021 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d004117c-2a1d-4acc-8a07-58fd00a96293 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:39.449173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d004117c-2a1d-4acc-8a07-58fd00a96293 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:39.457060 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d004117c-2a1d-4acc-8a07-58fd00a96293 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.149128 Jul 12 13:44:39.457628 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 212/432] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:39 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:39.638485 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2907b965-8511-4a79-9a7e-f8dffd60acf6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:39.639098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2907b965-8511-4a79-9a7e-f8dffd60acf6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:39.645599 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2907b965-8511-4a79-9a7e-f8dffd60acf6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:39.646079 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2907b965-8511-4a79-9a7e-f8dffd60acf6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:39.646848 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2907b965-8511-4a79-9a7e-f8dffd60acf6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:39.647289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2907b965-8511-4a79-9a7e-f8dffd60acf6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:39.705946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2907b965-8511-4a79-9a7e-f8dffd60acf6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:39.713765 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2907b965-8511-4a79-9a7e-f8dffd60acf6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1246 microversion: 2.1 time: 0.079057 Jul 12 13:44:39.714359 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 221/433] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:39 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:39.920511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-37982da3-d8ae-4c7e-88c7-48d866117ed0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:39.921117 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-37982da3-d8ae-4c7e-88c7-48d866117ed0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:39.927687 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-37982da3-d8ae-4c7e-88c7-48d866117ed0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:39.928134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-37982da3-d8ae-4c7e-88c7-48d866117ed0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:39.928890 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-37982da3-d8ae-4c7e-88c7-48d866117ed0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:39.929328 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-37982da3-d8ae-4c7e-88c7-48d866117ed0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:40.056196 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-37982da3-d8ae-4c7e-88c7-48d866117ed0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:40.064359 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-37982da3-d8ae-4c7e-88c7-48d866117ed0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:40.066412 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-37982da3-d8ae-4c7e-88c7-48d866117ed0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:40.068058 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-37982da3-d8ae-4c7e-88c7-48d866117ed0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1744 microversion: 2.20 time: 0.151406 Jul 12 13:44:40.068647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 213/434] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:39 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:40.322849 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-facd2b77-95d8-49e6-9794-f6a25773d9e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:40.323373 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-facd2b77-95d8-49e6-9794-f6a25773d9e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:40.329873 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-facd2b77-95d8-49e6-9794-f6a25773d9e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:40.330362 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-facd2b77-95d8-49e6-9794-f6a25773d9e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:40.331130 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-facd2b77-95d8-49e6-9794-f6a25773d9e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:40.331573 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-facd2b77-95d8-49e6-9794-f6a25773d9e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:40.474241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-675555d3-b0da-4ac4-8352-730311682e61 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:40.474853 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-675555d3-b0da-4ac4-8352-730311682e61 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:40.481121 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-675555d3-b0da-4ac4-8352-730311682e61 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:40.481595 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-675555d3-b0da-4ac4-8352-730311682e61 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:40.482397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-675555d3-b0da-4ac4-8352-730311682e61 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:40.482833 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-675555d3-b0da-4ac4-8352-730311682e61 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:40.625276 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-675555d3-b0da-4ac4-8352-730311682e61 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:40.634337 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-675555d3-b0da-4ac4-8352-730311682e61 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1722 microversion: 2.1 time: 0.163941 Jul 12 13:44:40.634919 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 214/435] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:40 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:40.684413 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-facd2b77-95d8-49e6-9794-f6a25773d9e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:40.692517 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-facd2b77-95d8-49e6-9794-f6a25773d9e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.372921 Jul 12 13:44:40.693077 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 222/436] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:40 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:40.730350 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6eee0a87-4de7-4953-b8c3-62709f80a369 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:40.730967 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6eee0a87-4de7-4953-b8c3-62709f80a369 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:40.737387 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6eee0a87-4de7-4953-b8c3-62709f80a369 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:40.737833 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6eee0a87-4de7-4953-b8c3-62709f80a369 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:40.738620 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6eee0a87-4de7-4953-b8c3-62709f80a369 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:40.739662 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6eee0a87-4de7-4953-b8c3-62709f80a369 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:40.806183 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6eee0a87-4de7-4953-b8c3-62709f80a369 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:40.813609 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6eee0a87-4de7-4953-b8c3-62709f80a369 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1246 microversion: 2.1 time: 0.087045 Jul 12 13:44:40.814207 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 215/437] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:40 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:41.086298 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a7f0158f-fa03-4582-a944-25cf2906b917 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:41.087008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a7f0158f-fa03-4582-a944-25cf2906b917 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:41.093104 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a7f0158f-fa03-4582-a944-25cf2906b917 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:41.093560 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a7f0158f-fa03-4582-a944-25cf2906b917 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:41.094955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a7f0158f-fa03-4582-a944-25cf2906b917 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:41.094955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a7f0158f-fa03-4582-a944-25cf2906b917 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:41.230915 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a7f0158f-fa03-4582-a944-25cf2906b917 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:41.238823 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a7f0158f-fa03-4582-a944-25cf2906b917 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:41.240304 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a7f0158f-fa03-4582-a944-25cf2906b917 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:41.241468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a7f0158f-fa03-4582-a944-25cf2906b917 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1744 microversion: 2.20 time: 0.159297 Jul 12 13:44:41.242030 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 223/438] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:41 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:41.655279 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0fb84736-ad18-4d21-98e9-f531fa94acfd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:41.656042 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0fb84736-ad18-4d21-98e9-f531fa94acfd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:41.663145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0fb84736-ad18-4d21-98e9-f531fa94acfd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:41.663753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0fb84736-ad18-4d21-98e9-f531fa94acfd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:41.664659 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0fb84736-ad18-4d21-98e9-f531fa94acfd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:41.665163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0fb84736-ad18-4d21-98e9-f531fa94acfd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:41.709319 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-612147f6-e0df-4097-83de-1eecc4750a2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:41.710353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-612147f6-e0df-4097-83de-1eecc4750a2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:41.717222 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-612147f6-e0df-4097-83de-1eecc4750a2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:41.718039 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-612147f6-e0df-4097-83de-1eecc4750a2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:41.719060 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-612147f6-e0df-4097-83de-1eecc4750a2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:41.719737 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-612147f6-e0df-4097-83de-1eecc4750a2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:41.741277 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:41.852063 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0fb84736-ad18-4d21-98e9-f531fa94acfd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:41.860981 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0fb84736-ad18-4d21-98e9-f531fa94acfd tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1699 microversion: 2.1 time: 0.212714 Jul 12 13:44:41.861856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 216/439] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:41 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1699 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:41.871895 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b321154c-dc7a-4cc2-b976-f3f7f006845f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:41.872646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b321154c-dc7a-4cc2-b976-f3f7f006845f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:41.880772 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b321154c-dc7a-4cc2-b976-f3f7f006845f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:41.881224 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b321154c-dc7a-4cc2-b976-f3f7f006845f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:41.882036 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b321154c-dc7a-4cc2-b976-f3f7f006845f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:41.882482 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b321154c-dc7a-4cc2-b976-f3f7f006845f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:41.883231 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-612147f6-e0df-4097-83de-1eecc4750a2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:41.891307 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-612147f6-e0df-4097-83de-1eecc4750a2b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.186229 Jul 12 13:44:41.891651 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 224/440] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:41 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:41.905292 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-17a0c245-c74b-4965-b4c9-dda9d1f131d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:41.911598 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17a0c245-c74b-4965-b4c9-dda9d1f131d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:41.912291 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17a0c245-c74b-4965-b4c9-dda9d1f131d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:41.976923 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-17a0c245-c74b-4965-b4c9-dda9d1f131d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Going to try to start instance {{(pid=124466) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 13:44:41.991950 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b321154c-dc7a-4cc2-b976-f3f7f006845f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:42.016722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b321154c-dc7a-4cc2-b976-f3f7f006845f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1300 microversion: 2.1 time: 0.144678 Jul 12 13:44:42.018399 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 217/441] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:41 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:42.048157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-17a0c245-c74b-4965-b4c9-dda9d1f131d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/action" status: 202 len: 0 microversion: 2.1 time: 0.146468 Jul 12 13:44:42.049665 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 225/442] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:44:41 2022] POST /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:44:42.060405 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0511088e-f99d-4a78-8000-efbae8e801ad tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:42.061193 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0511088e-f99d-4a78-8000-efbae8e801ad tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:42.073141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0511088e-f99d-4a78-8000-efbae8e801ad tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:42.074064 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0511088e-f99d-4a78-8000-efbae8e801ad tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:42.074970 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0511088e-f99d-4a78-8000-efbae8e801ad tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:42.075625 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0511088e-f99d-4a78-8000-efbae8e801ad tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:42.260834 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-91a219f4-b72d-44a8-8663-ee238b603ccd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:42.262392 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-91a219f4-b72d-44a8-8663-ee238b603ccd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:42.271074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91a219f4-b72d-44a8-8663-ee238b603ccd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:42.271742 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91a219f4-b72d-44a8-8663-ee238b603ccd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:42.273076 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91a219f4-b72d-44a8-8663-ee238b603ccd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:42.273661 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91a219f4-b72d-44a8-8663-ee238b603ccd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:42.392640 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0511088e-f99d-4a78-8000-efbae8e801ad tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:42.403428 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0511088e-f99d-4a78-8000-efbae8e801ad tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1708 microversion: 2.1 time: 0.348877 Jul 12 13:44:42.404009 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 218/443] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:42 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1708 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:42.637285 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-91a219f4-b72d-44a8-8663-ee238b603ccd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:42.670819 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-91a219f4-b72d-44a8-8663-ee238b603ccd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:42.675393 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-91a219f4-b72d-44a8-8663-ee238b603ccd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:42.682162 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-91a219f4-b72d-44a8-8663-ee238b603ccd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.425951 Jul 12 13:44:42.683166 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 226/444] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:42 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:42.908521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8caf44af-2685-4f78-9b48-b506078344d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:42.909674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8caf44af-2685-4f78-9b48-b506078344d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:42.924379 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8caf44af-2685-4f78-9b48-b506078344d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:42.927216 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8caf44af-2685-4f78-9b48-b506078344d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:42.929139 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8caf44af-2685-4f78-9b48-b506078344d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:42.935398 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8caf44af-2685-4f78-9b48-b506078344d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:43.039179 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-758ec2d6-d387-460a-af01-e4f5afbb8211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:43.040402 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-758ec2d6-d387-460a-af01-e4f5afbb8211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:43.063932 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-758ec2d6-d387-460a-af01-e4f5afbb8211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:43.064387 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-758ec2d6-d387-460a-af01-e4f5afbb8211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:43.065187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-758ec2d6-d387-460a-af01-e4f5afbb8211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:43.065627 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-758ec2d6-d387-460a-af01-e4f5afbb8211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:43.428767 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-758ec2d6-d387-460a-af01-e4f5afbb8211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:43.441535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-758ec2d6-d387-460a-af01-e4f5afbb8211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1367 microversion: 2.1 time: 0.409511 Jul 12 13:44:43.443306 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 227/445] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:43 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:43.447979 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-55eb4265-e045-466b-af3a-b87f09fa424a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:43.454810 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-55eb4265-e045-466b-af3a-b87f09fa424a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:43.472026 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-55eb4265-e045-466b-af3a-b87f09fa424a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:43.472695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-55eb4265-e045-466b-af3a-b87f09fa424a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:43.473706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-55eb4265-e045-466b-af3a-b87f09fa424a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:43.474355 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-55eb4265-e045-466b-af3a-b87f09fa424a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:43.711474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8caf44af-2685-4f78-9b48-b506078344d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:43.726839 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8caf44af-2685-4f78-9b48-b506078344d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.823270 Jul 12 13:44:43.729102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 219/446] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:42 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:43.740817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-25c17609-7b75-4318-bcff-149374c3fb2c req-c9f9fb5d-2298-4e67-b7ec-34b4330733b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42ee030-0bf1-402b-b7f4-9c9a33ac5aee", "name": "network-vif-plugged", "status": "completed", "tag": "24703b74-9dc6-4b80-a6ab-4c0de6ab1334"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:43.773274 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-25c17609-7b75-4318-bcff-149374c3fb2c req-c9f9fb5d-2298-4e67-b7ec-34b4330733b8 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:43.776400 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-25c17609-7b75-4318-bcff-149374c3fb2c req-c9f9fb5d-2298-4e67-b7ec-34b4330733b8 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:43.796967 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-25c17609-7b75-4318-bcff-149374c3fb2c req-c9f9fb5d-2298-4e67-b7ec-34b4330733b8 service nova] Creating event network-vif-plugged:24703b74-9dc6-4b80-a6ab-4c0de6ab1334 for instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee on hv-cinder-79797 Jul 12 13:44:43.818600 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-25c17609-7b75-4318-bcff-149374c3fb2c req-c9f9fb5d-2298-4e67-b7ec-34b4330733b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086103 Jul 12 13:44:43.819259 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-55eb4265-e045-466b-af3a-b87f09fa424a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:43.823118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 220/447] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:43.835502 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-55eb4265-e045-466b-af3a-b87f09fa424a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1708 microversion: 2.1 time: 0.390974 Jul 12 13:44:43.840023 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 228/448] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:43 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1708 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:43.840873 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ffddef5f-3b14-4084-8608-864fdcfa021b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:43.842067 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ffddef5f-3b14-4084-8608-864fdcfa021b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:43.871390 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ffddef5f-3b14-4084-8608-864fdcfa021b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:43.877641 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ffddef5f-3b14-4084-8608-864fdcfa021b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:43.878865 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ffddef5f-3b14-4084-8608-864fdcfa021b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:43.880262 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ffddef5f-3b14-4084-8608-864fdcfa021b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:44.336051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ffddef5f-3b14-4084-8608-864fdcfa021b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:44.349626 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ffddef5f-3b14-4084-8608-864fdcfa021b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:44.364512 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ffddef5f-3b14-4084-8608-864fdcfa021b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:44.366204 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ffddef5f-3b14-4084-8608-864fdcfa021b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.540013 Jul 12 13:44:44.379789 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 221/449] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:43 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:44.462357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-608d24cd-9899-4cc0-bbe9-9695912bd44f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:44.463725 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-608d24cd-9899-4cc0-bbe9-9695912bd44f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:44.476584 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-608d24cd-9899-4cc0-bbe9-9695912bd44f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:44.483027 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-608d24cd-9899-4cc0-bbe9-9695912bd44f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:44.485488 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-608d24cd-9899-4cc0-bbe9-9695912bd44f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:44.486192 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-608d24cd-9899-4cc0-bbe9-9695912bd44f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:44.747033 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-75bd36f2-99fa-4384-a216-5cda0c4f5daf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:44.747939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-75bd36f2-99fa-4384-a216-5cda0c4f5daf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:44.757749 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-75bd36f2-99fa-4384-a216-5cda0c4f5daf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:44.759708 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-75bd36f2-99fa-4384-a216-5cda0c4f5daf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:44.760700 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-75bd36f2-99fa-4384-a216-5cda0c4f5daf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:44.762695 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-75bd36f2-99fa-4384-a216-5cda0c4f5daf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:44.851680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-608d24cd-9899-4cc0-bbe9-9695912bd44f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:44.873378 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-608d24cd-9899-4cc0-bbe9-9695912bd44f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1367 microversion: 2.1 time: 0.416126 Jul 12 13:44:44.876393 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 229/450] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:44 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1367 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:44.885513 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c855a7c2-fe50-416b-8ca2-32b73050f20e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:44.891834 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c855a7c2-fe50-416b-8ca2-32b73050f20e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:44.899455 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c855a7c2-fe50-416b-8ca2-32b73050f20e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:44.900251 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c855a7c2-fe50-416b-8ca2-32b73050f20e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:44.901280 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c855a7c2-fe50-416b-8ca2-32b73050f20e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:44.901937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c855a7c2-fe50-416b-8ca2-32b73050f20e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:45.178518 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c855a7c2-fe50-416b-8ca2-32b73050f20e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:45.190372 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c855a7c2-fe50-416b-8ca2-32b73050f20e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1712 microversion: 2.1 time: 0.312399 Jul 12 13:44:45.191104 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 230/451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:44 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1712 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:45.199833 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-4db080ff-6e9d-4bb8-8ce2-ac2e0a9f93b0 req-acc54d0a-4983-4855-a941-9f7f9298e991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95cd2ee8-a4fd-4ff1-90ac-a475974c4f98", "tag": "0af76070-e7f5-404e-a34f-bffbaa7ffbfe"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:45.214043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-75bd36f2-99fa-4384-a216-5cda0c4f5daf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:45.219805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-4db080ff-6e9d-4bb8-8ce2-ac2e0a9f93b0 req-acc54d0a-4983-4855-a941-9f7f9298e991 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:45.220368 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-4db080ff-6e9d-4bb8-8ce2-ac2e0a9f93b0 req-acc54d0a-4983-4855-a941-9f7f9298e991 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:45.228088 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-75bd36f2-99fa-4384-a216-5cda0c4f5daf tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.484815 Jul 12 13:44:45.228937 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 222/452] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:44 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:44:45.250323 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-4db080ff-6e9d-4bb8-8ce2-ac2e0a9f93b0 req-acc54d0a-4983-4855-a941-9f7f9298e991 service nova] Creating event network-changed:0af76070-e7f5-404e-a34f-bffbaa7ffbfe for instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 on hv-cinder-79797 Jul 12 13:44:45.266208 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-4db080ff-6e9d-4bb8-8ce2-ac2e0a9f93b0 req-acc54d0a-4983-4855-a941-9f7f9298e991 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073718 Jul 12 13:44:45.267289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 231/453] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:45.390322 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bb0cf3d7-351b-4faf-9a93-3b063a266304 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:45.391577 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bb0cf3d7-351b-4faf-9a93-3b063a266304 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:45.401761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bb0cf3d7-351b-4faf-9a93-3b063a266304 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:45.414640 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bb0cf3d7-351b-4faf-9a93-3b063a266304 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:45.415655 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bb0cf3d7-351b-4faf-9a93-3b063a266304 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:45.416349 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bb0cf3d7-351b-4faf-9a93-3b063a266304 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:45.632807 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bb0cf3d7-351b-4faf-9a93-3b063a266304 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:45.655236 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bb0cf3d7-351b-4faf-9a93-3b063a266304 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:45.658130 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bb0cf3d7-351b-4faf-9a93-3b063a266304 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:45.659646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bb0cf3d7-351b-4faf-9a93-3b063a266304 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.273207 Jul 12 13:44:45.660670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 223/454] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:45 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:45.900310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-badc41d6-88d9-4b34-9343-b1c078a1f346 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:45.901931 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-badc41d6-88d9-4b34-9343-b1c078a1f346 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:45.918622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-badc41d6-88d9-4b34-9343-b1c078a1f346 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:45.919362 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-badc41d6-88d9-4b34-9343-b1c078a1f346 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:45.920321 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-badc41d6-88d9-4b34-9343-b1c078a1f346 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:45.920933 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-badc41d6-88d9-4b34-9343-b1c078a1f346 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:46.165042 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-badc41d6-88d9-4b34-9343-b1c078a1f346 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:46.192778 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-badc41d6-88d9-4b34-9343-b1c078a1f346 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1367 microversion: 2.1 time: 0.302961 Jul 12 13:44:46.205902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 232/455] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:45 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:46.249616 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-fcd5e8b7-0fa4-45c0-9c88-5e833ed2e579 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:46.250699 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-fcd5e8b7-0fa4-45c0-9c88-5e833ed2e579 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:46.262840 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fcd5e8b7-0fa4-45c0-9c88-5e833ed2e579 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:46.263622 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fcd5e8b7-0fa4-45c0-9c88-5e833ed2e579 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:46.265146 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fcd5e8b7-0fa4-45c0-9c88-5e833ed2e579 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:46.265749 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fcd5e8b7-0fa4-45c0-9c88-5e833ed2e579 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:46.468339 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-fcd5e8b7-0fa4-45c0-9c88-5e833ed2e579 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:46.477612 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-fcd5e8b7-0fa4-45c0-9c88-5e833ed2e579 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1370 microversion: 2.1 time: 0.236159 Jul 12 13:44:46.478321 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 224/456] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:46 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:46.682944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-49eabe13-f94b-4d5e-8bc0-dd15e1ef356e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:46.682944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-49eabe13-f94b-4d5e-8bc0-dd15e1ef356e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:46.690045 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49eabe13-f94b-4d5e-8bc0-dd15e1ef356e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:46.693855 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49eabe13-f94b-4d5e-8bc0-dd15e1ef356e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:46.694833 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49eabe13-f94b-4d5e-8bc0-dd15e1ef356e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:46.695738 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49eabe13-f94b-4d5e-8bc0-dd15e1ef356e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:46.911966 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-49eabe13-f94b-4d5e-8bc0-dd15e1ef356e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:46.922659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-49eabe13-f94b-4d5e-8bc0-dd15e1ef356e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:46.924363 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-49eabe13-f94b-4d5e-8bc0-dd15e1ef356e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:46.925721 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-49eabe13-f94b-4d5e-8bc0-dd15e1ef356e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.249312 Jul 12 13:44:46.927185 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 233/457] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:46 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:47.218379 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-cd3a4bd7-93d3-4d4f-ac3d-c573dccd107f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:47.224947 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-cd3a4bd7-93d3-4d4f-ac3d-c573dccd107f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:47.239495 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd3a4bd7-93d3-4d4f-ac3d-c573dccd107f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:47.247267 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd3a4bd7-93d3-4d4f-ac3d-c573dccd107f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:47.250711 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd3a4bd7-93d3-4d4f-ac3d-c573dccd107f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:47.251892 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd3a4bd7-93d3-4d4f-ac3d-c573dccd107f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:47.456014 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-cd3a4bd7-93d3-4d4f-ac3d-c573dccd107f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:47.466939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-cd3a4bd7-93d3-4d4f-ac3d-c573dccd107f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1367 microversion: 2.1 time: 0.254378 Jul 12 13:44:47.476653 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 225/458] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:47 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:47.497907 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f90aa8e4-a683-4fa1-a3f7-18ade90daa66 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:47.498804 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f90aa8e4-a683-4fa1-a3f7-18ade90daa66 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:47.509804 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f90aa8e4-a683-4fa1-a3f7-18ade90daa66 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:47.518692 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f90aa8e4-a683-4fa1-a3f7-18ade90daa66 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:47.524917 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f90aa8e4-a683-4fa1-a3f7-18ade90daa66 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:47.525738 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f90aa8e4-a683-4fa1-a3f7-18ade90daa66 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:47.706197 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f90aa8e4-a683-4fa1-a3f7-18ade90daa66 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:47.714543 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f90aa8e4-a683-4fa1-a3f7-18ade90daa66 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1564 microversion: 2.1 time: 0.223084 Jul 12 13:44:47.715318 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 234/459] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:47 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1564 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:47.734748 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0178861e-7d7b-483d-859f-fabbba6a4449 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:47.735192 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0178861e-7d7b-483d-859f-fabbba6a4449 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:47.742120 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0178861e-7d7b-483d-859f-fabbba6a4449 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:47.742579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0178861e-7d7b-483d-859f-fabbba6a4449 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:47.743379 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0178861e-7d7b-483d-859f-fabbba6a4449 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:47.743822 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0178861e-7d7b-483d-859f-fabbba6a4449 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:47.857404 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0178861e-7d7b-483d-859f-fabbba6a4449 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129253 Jul 12 13:44:47.866382 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 226/460] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jul 12 13:44:47 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:47.945096 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-78cad732-dc83-4993-8d1d-f2fa784f2f42 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:47.945735 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-78cad732-dc83-4993-8d1d-f2fa784f2f42 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:47.956378 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-78cad732-dc83-4993-8d1d-f2fa784f2f42 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:47.956847 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-78cad732-dc83-4993-8d1d-f2fa784f2f42 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:47.962421 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-78cad732-dc83-4993-8d1d-f2fa784f2f42 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:47.964991 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-78cad732-dc83-4993-8d1d-f2fa784f2f42 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:48.400532 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-78cad732-dc83-4993-8d1d-f2fa784f2f42 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:48.409367 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-78cad732-dc83-4993-8d1d-f2fa784f2f42 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:48.421865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-78cad732-dc83-4993-8d1d-f2fa784f2f42 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:48.424676 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-78cad732-dc83-4993-8d1d-f2fa784f2f42 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.483930 Jul 12 13:44:48.437874 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 235/461] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:47 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:48.485165 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-83e4dd87-eb40-4af6-b18e-6bc399b5b62c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:48.486663 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-83e4dd87-eb40-4af6-b18e-6bc399b5b62c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:48.498738 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:48.499833 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=10 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:48.501895 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83e4dd87-eb40-4af6-b18e-6bc399b5b62c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:48.505443 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83e4dd87-eb40-4af6-b18e-6bc399b5b62c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:48.508911 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83e4dd87-eb40-4af6-b18e-6bc399b5b62c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:48.509620 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83e4dd87-eb40-4af6-b18e-6bc399b5b62c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:48.594995 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=100 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:48.966365 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-83e4dd87-eb40-4af6-b18e-6bc399b5b62c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:48.979090 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-83e4dd87-eb40-4af6-b18e-6bc399b5b62c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1367 microversion: 2.1 time: 0.498466 Jul 12 13:44:48.980115 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 227/462] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:48 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1367 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:49.453455 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5b1fa168-9b67-4efd-8df0-4c3facb39099 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:49.455201 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5b1fa168-9b67-4efd-8df0-4c3facb39099 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:49.468347 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:49.471554 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b1fa168-9b67-4efd-8df0-4c3facb39099 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:49.472947 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b1fa168-9b67-4efd-8df0-4c3facb39099 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:49.473637 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b1fa168-9b67-4efd-8df0-4c3facb39099 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:49.474830 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5b1fa168-9b67-4efd-8df0-4c3facb39099 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:49.996766 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d44892b6-1fac-470c-ab36-7f355f0366e9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:49.998019 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d44892b6-1fac-470c-ab36-7f355f0366e9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:50.018769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5b1fa168-9b67-4efd-8df0-4c3facb39099 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:50.025681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d44892b6-1fac-470c-ab36-7f355f0366e9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:50.029683 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5b1fa168-9b67-4efd-8df0-4c3facb39099 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:50.033981 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d44892b6-1fac-470c-ab36-7f355f0366e9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:50.034723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d44892b6-1fac-470c-ab36-7f355f0366e9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:50.035183 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d44892b6-1fac-470c-ab36-7f355f0366e9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:50.039758 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5b1fa168-9b67-4efd-8df0-4c3facb39099 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:50.040851 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5b1fa168-9b67-4efd-8df0-4c3facb39099 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.593136 Jul 12 13:44:50.041790 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 236/463] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:49 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:50.106370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-cefff86f-5a98-47af-92ef-112937243aa8 req-2def1d7a-3064-46c3-9f35-9d8d69d30898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42ee030-0bf1-402b-b7f4-9c9a33ac5aee", "tag": "24703b74-9dc6-4b80-a6ab-4c0de6ab1334"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:50.125056 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-cefff86f-5a98-47af-92ef-112937243aa8 req-2def1d7a-3064-46c3-9f35-9d8d69d30898 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:50.125495 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-cefff86f-5a98-47af-92ef-112937243aa8 req-2def1d7a-3064-46c3-9f35-9d8d69d30898 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:50.157044 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-cefff86f-5a98-47af-92ef-112937243aa8 req-2def1d7a-3064-46c3-9f35-9d8d69d30898 service nova] Creating event network-changed:24703b74-9dc6-4b80-a6ab-4c0de6ab1334 for instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee on hv-cinder-79797 Jul 12 13:44:50.164940 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-cefff86f-5a98-47af-92ef-112937243aa8 req-2def1d7a-3064-46c3-9f35-9d8d69d30898 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062428 Jul 12 13:44:50.168860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 237/464] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:44:50.490801 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d44892b6-1fac-470c-ab36-7f355f0366e9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:50.490801 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d44892b6-1fac-470c-ab36-7f355f0366e9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1367 microversion: 2.1 time: 0.483099 Jul 12 13:44:50.490801 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 228/465] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:49 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:51.061248 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0ec1680f-2614-493b-ad12-4899e21921ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:51.062148 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0ec1680f-2614-493b-ad12-4899e21921ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:51.081475 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0ec1680f-2614-493b-ad12-4899e21921ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:51.085821 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0ec1680f-2614-493b-ad12-4899e21921ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:51.087125 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0ec1680f-2614-493b-ad12-4899e21921ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:51.090588 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0ec1680f-2614-493b-ad12-4899e21921ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:51.434357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0ec1680f-2614-493b-ad12-4899e21921ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:51.444859 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0ec1680f-2614-493b-ad12-4899e21921ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:51.459242 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0ec1680f-2614-493b-ad12-4899e21921ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:51.461093 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0ec1680f-2614-493b-ad12-4899e21921ee tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.405301 Jul 12 13:44:51.472310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 238/466] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:51 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:51.493001 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e31bd813-a078-461b-9c97-2fccc891b64d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:51.494606 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e31bd813-a078-461b-9c97-2fccc891b64d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:51.516963 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e31bd813-a078-461b-9c97-2fccc891b64d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:51.520290 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e31bd813-a078-461b-9c97-2fccc891b64d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:51.521373 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e31bd813-a078-461b-9c97-2fccc891b64d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:51.524380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e31bd813-a078-461b-9c97-2fccc891b64d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:51.568981 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-1e57a14a-ddd8-430b-b3ff-6db984ad0db2 req-dc119719-e4b4-4535-87a6-ffaa283ee59c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cd2ee8-a4fd-4ff1-90ac-a475974c4f98", "name": "network-vif-plugged", "status": "completed", "tag": "0af76070-e7f5-404e-a34f-bffbaa7ffbfe"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:51.586513 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-1e57a14a-ddd8-430b-b3ff-6db984ad0db2 req-dc119719-e4b4-4535-87a6-ffaa283ee59c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:51.587011 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-1e57a14a-ddd8-430b-b3ff-6db984ad0db2 req-dc119719-e4b4-4535-87a6-ffaa283ee59c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:51.626368 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-1e57a14a-ddd8-430b-b3ff-6db984ad0db2 req-dc119719-e4b4-4535-87a6-ffaa283ee59c service nova] Creating event network-vif-plugged:0af76070-e7f5-404e-a34f-bffbaa7ffbfe for instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 on hv-cinder-79797 Jul 12 13:44:51.648798 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-1e57a14a-ddd8-430b-b3ff-6db984ad0db2 req-dc119719-e4b4-4535-87a6-ffaa283ee59c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084188 Jul 12 13:44:51.655411 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 239/467] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:51.892891 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e31bd813-a078-461b-9c97-2fccc891b64d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:51.906771 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e31bd813-a078-461b-9c97-2fccc891b64d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1367 microversion: 2.1 time: 0.417624 Jul 12 13:44:51.913021 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 229/468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:51 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:52.481829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7942fda7-4b6b-42ca-9bdd-a8cac7953bb0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:52.482569 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7942fda7-4b6b-42ca-9bdd-a8cac7953bb0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:52.492544 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7942fda7-4b6b-42ca-9bdd-a8cac7953bb0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:52.493018 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7942fda7-4b6b-42ca-9bdd-a8cac7953bb0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:52.493776 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7942fda7-4b6b-42ca-9bdd-a8cac7953bb0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:52.497815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7942fda7-4b6b-42ca-9bdd-a8cac7953bb0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:52.643019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7942fda7-4b6b-42ca-9bdd-a8cac7953bb0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:52.652241 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7942fda7-4b6b-42ca-9bdd-a8cac7953bb0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:52.653952 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7942fda7-4b6b-42ca-9bdd-a8cac7953bb0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:52.654990 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7942fda7-4b6b-42ca-9bdd-a8cac7953bb0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.177346 Jul 12 13:44:52.669635 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 240/469] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:52 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:52.924489 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-9b548e83-af8c-4c50-a312-6ae306ba33a9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:52.926006 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-9b548e83-af8c-4c50-a312-6ae306ba33a9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:52.932720 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9b548e83-af8c-4c50-a312-6ae306ba33a9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:52.933443 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9b548e83-af8c-4c50-a312-6ae306ba33a9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:52.936670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9b548e83-af8c-4c50-a312-6ae306ba33a9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:52.937361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9b548e83-af8c-4c50-a312-6ae306ba33a9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:53.150219 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-9b548e83-af8c-4c50-a312-6ae306ba33a9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:53.163412 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-9b548e83-af8c-4c50-a312-6ae306ba33a9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1367 microversion: 2.1 time: 0.242679 Jul 12 13:44:53.178790 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 230/470] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:52 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:53.672874 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9946e935-4fe8-4fd7-b350-026980549335 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:53.673480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9946e935-4fe8-4fd7-b350-026980549335 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:53.684657 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9946e935-4fe8-4fd7-b350-026980549335 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:53.690513 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9946e935-4fe8-4fd7-b350-026980549335 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:53.691550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9946e935-4fe8-4fd7-b350-026980549335 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:53.692131 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9946e935-4fe8-4fd7-b350-026980549335 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:53.864298 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9946e935-4fe8-4fd7-b350-026980549335 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:53.873097 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9946e935-4fe8-4fd7-b350-026980549335 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:53.876122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9946e935-4fe8-4fd7-b350-026980549335 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:53.877898 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9946e935-4fe8-4fd7-b350-026980549335 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.209197 Jul 12 13:44:53.888199 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 241/471] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:53 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:54.189315 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-72a31154-b8da-432b-b052-f000f9747a99 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:54.197599 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-72a31154-b8da-432b-b052-f000f9747a99 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:54.208012 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72a31154-b8da-432b-b052-f000f9747a99 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:54.208469 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72a31154-b8da-432b-b052-f000f9747a99 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:54.209262 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72a31154-b8da-432b-b052-f000f9747a99 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:54.209701 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-72a31154-b8da-432b-b052-f000f9747a99 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:54.424307 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-72a31154-b8da-432b-b052-f000f9747a99 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:54.425696 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-72a31154-b8da-432b-b052-f000f9747a99 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1556 microversion: 2.1 time: 0.242077 Jul 12 13:44:54.435646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 231/472] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:44:54 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1556 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:44:54.444569 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4d26ee21-c2bc-431d-83c7-278377b96a28 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:54.444980 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4d26ee21-c2bc-431d-83c7-278377b96a28 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:54.451612 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d26ee21-c2bc-431d-83c7-278377b96a28 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:54.452059 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d26ee21-c2bc-431d-83c7-278377b96a28 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:54.452842 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d26ee21-c2bc-431d-83c7-278377b96a28 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:54.453274 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4d26ee21-c2bc-431d-83c7-278377b96a28 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:54.458260 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:54.578288 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4d26ee21-c2bc-431d-83c7-278377b96a28 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138207 Jul 12 13:44:54.580270 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 242/473] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jul 12 13:44:54 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:54.895922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b0c65784-d46e-474e-a11e-99ce4a2a9430 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:54.896728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b0c65784-d46e-474e-a11e-99ce4a2a9430 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:54.905195 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b0c65784-d46e-474e-a11e-99ce4a2a9430 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:54.918372 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b0c65784-d46e-474e-a11e-99ce4a2a9430 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:54.919436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b0c65784-d46e-474e-a11e-99ce4a2a9430 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:54.919968 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b0c65784-d46e-474e-a11e-99ce4a2a9430 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:55.131900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b0c65784-d46e-474e-a11e-99ce4a2a9430 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:55.142728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b0c65784-d46e-474e-a11e-99ce4a2a9430 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:55.146538 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b0c65784-d46e-474e-a11e-99ce4a2a9430 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:55.147847 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b0c65784-d46e-474e-a11e-99ce4a2a9430 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.255906 Jul 12 13:44:55.148673 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 232/474] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:54 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:56.033310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-d1c174b2-202d-4457-b2fe-476e4cb05c24 req-baa352bd-a463-4e42-8305-e292f4057fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95cd2ee8-a4fd-4ff1-90ac-a475974c4f98", "tag": "0af76070-e7f5-404e-a34f-bffbaa7ffbfe"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:56.045871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-d1c174b2-202d-4457-b2fe-476e4cb05c24 req-baa352bd-a463-4e42-8305-e292f4057fd4 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:56.046471 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-d1c174b2-202d-4457-b2fe-476e4cb05c24 req-baa352bd-a463-4e42-8305-e292f4057fd4 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:56.059062 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-d1c174b2-202d-4457-b2fe-476e4cb05c24 req-baa352bd-a463-4e42-8305-e292f4057fd4 service nova] Creating event network-changed:0af76070-e7f5-404e-a34f-bffbaa7ffbfe for instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 on hv-cinder-79797 Jul 12 13:44:56.064369 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-d1c174b2-202d-4457-b2fe-476e4cb05c24 req-baa352bd-a463-4e42-8305-e292f4057fd4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035939 Jul 12 13:44:56.065471 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 243/475] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:44:56.167218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7e31afaf-b95a-4158-ba92-798d76033980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:56.168693 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7e31afaf-b95a-4158-ba92-798d76033980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:56.175874 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e31afaf-b95a-4158-ba92-798d76033980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:56.176618 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e31afaf-b95a-4158-ba92-798d76033980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:56.177619 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e31afaf-b95a-4158-ba92-798d76033980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:56.178435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e31afaf-b95a-4158-ba92-798d76033980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:56.759547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7e31afaf-b95a-4158-ba92-798d76033980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:56.770033 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7e31afaf-b95a-4158-ba92-798d76033980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:56.774433 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7e31afaf-b95a-4158-ba92-798d76033980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:56.779280 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7e31afaf-b95a-4158-ba92-798d76033980 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1739 microversion: 2.20 time: 0.616387 Jul 12 13:44:56.790558 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 233/476] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:56 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1739 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:57.798882 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-01f8c6df-b5b7-4957-9d37-6cca29c2b893 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:57.799592 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-01f8c6df-b5b7-4957-9d37-6cca29c2b893 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:57.806334 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01f8c6df-b5b7-4957-9d37-6cca29c2b893 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:57.806785 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01f8c6df-b5b7-4957-9d37-6cca29c2b893 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:57.807571 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01f8c6df-b5b7-4957-9d37-6cca29c2b893 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:57.808013 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01f8c6df-b5b7-4957-9d37-6cca29c2b893 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:57.955183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-01f8c6df-b5b7-4957-9d37-6cca29c2b893 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:57.963954 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-01f8c6df-b5b7-4957-9d37-6cca29c2b893 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:57.965593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-01f8c6df-b5b7-4957-9d37-6cca29c2b893 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:57.966777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-01f8c6df-b5b7-4957-9d37-6cca29c2b893 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1721 microversion: 2.20 time: 0.172771 Jul 12 13:44:57.967337 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 244/477] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:57 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:58.986259 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5fa37f8e-f411-4648-aeb3-0bd56bf7b212 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:44:58.987567 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5fa37f8e-f411-4648-aeb3-0bd56bf7b212 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:44:58.995183 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5fa37f8e-f411-4648-aeb3-0bd56bf7b212 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:58.995949 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5fa37f8e-f411-4648-aeb3-0bd56bf7b212 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:58.996964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5fa37f8e-f411-4648-aeb3-0bd56bf7b212 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:58.997624 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5fa37f8e-f411-4648-aeb3-0bd56bf7b212 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:59.168360 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5fa37f8e-f411-4648-aeb3-0bd56bf7b212 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:59.183764 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5fa37f8e-f411-4648-aeb3-0bd56bf7b212 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:59.186525 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5fa37f8e-f411-4648-aeb3-0bd56bf7b212 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:44:59.188728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5fa37f8e-f411-4648-aeb3-0bd56bf7b212 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1721 microversion: 2.20 time: 0.206016 Jul 12 13:44:59.198141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 234/478] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:44:58 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:44:59.795388 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-91fd28a8-72c0-40d1-aa36-7ee479edd5ff req-c5ca87ea-8fa8-4c28-bc5d-0a87d4825086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d01af-d429-48d6-9f16-6255557bdb67", "name": "network-vif-unplugged", "status": "completed", "tag": "35051ab0-4751-427b-ae9e-ddc1611523c0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:44:59.815098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-91fd28a8-72c0-40d1-aa36-7ee479edd5ff req-c5ca87ea-8fa8-4c28-bc5d-0a87d4825086 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:44:59.816712 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-91fd28a8-72c0-40d1-aa36-7ee479edd5ff req-c5ca87ea-8fa8-4c28-bc5d-0a87d4825086 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:44:59.850144 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-91fd28a8-72c0-40d1-aa36-7ee479edd5ff req-c5ca87ea-8fa8-4c28-bc5d-0a87d4825086 service nova] Creating event network-vif-unplugged:35051ab0-4751-427b-ae9e-ddc1611523c0 for instance e71d01af-d429-48d6-9f16-6255557bdb67 on hv-cinder-79797 Jul 12 13:44:59.857934 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-91fd28a8-72c0-40d1-aa36-7ee479edd5ff req-c5ca87ea-8fa8-4c28-bc5d-0a87d4825086 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066462 Jul 12 13:44:59.858880 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 245/479] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:45:00.209802 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ed5c222c-ecf4-4071-aac5-8a4c85d61218 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:00.210744 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ed5c222c-ecf4-4071-aac5-8a4c85d61218 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:00.224859 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ed5c222c-ecf4-4071-aac5-8a4c85d61218 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:00.226289 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ed5c222c-ecf4-4071-aac5-8a4c85d61218 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:00.227087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ed5c222c-ecf4-4071-aac5-8a4c85d61218 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:00.227532 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ed5c222c-ecf4-4071-aac5-8a4c85d61218 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:00.496310 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ed5c222c-ecf4-4071-aac5-8a4c85d61218 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:00.505940 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ed5c222c-ecf4-4071-aac5-8a4c85d61218 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:00.508023 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ed5c222c-ecf4-4071-aac5-8a4c85d61218 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:00.509561 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ed5c222c-ecf4-4071-aac5-8a4c85d61218 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1664 microversion: 2.20 time: 0.305656 Jul 12 13:45:00.510764 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 235/480] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:00 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1664 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:00.528760 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-40c2e3f6-66e1-4ac4-ae90-c75c1bd769a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c254755f-f20e-4c48-a6a1-4773ab5ccd55"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:45:00.530580 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-40c2e3f6-66e1-4ac4-ae90-c75c1bd769a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:00.538226 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40c2e3f6-66e1-4ac4-ae90-c75c1bd769a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:00.538684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40c2e3f6-66e1-4ac4-ae90-c75c1bd769a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:00.539480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40c2e3f6-66e1-4ac4-ae90-c75c1bd769a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:00.539922 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-40c2e3f6-66e1-4ac4-ae90-c75c1bd769a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:00.970432 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-40c2e3f6-66e1-4ac4-ae90-c75c1bd769a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "POST /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.445955 Jul 12 13:45:00.978777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 246/481] 10.222.0.52 () {62 vars in 1363 bytes} [Tue Jul 12 13:45:00 2022] POST /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments => generated 188 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:45:01.122812 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-752223d9-52c8-4318-b45e-c7927dd0b65c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:45:01.124028 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-752223d9-52c8-4318-b45e-c7927dd0b65c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:01.127088 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:01.134785 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-752223d9-52c8-4318-b45e-c7927dd0b65c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:01.135625 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-752223d9-52c8-4318-b45e-c7927dd0b65c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:01.136680 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-752223d9-52c8-4318-b45e-c7927dd0b65c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:01.137240 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-752223d9-52c8-4318-b45e-c7927dd0b65c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:01.264022 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-752223d9-52c8-4318-b45e-c7927dd0b65c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "POST /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/action" status: 202 len: 0 microversion: 2.20 time: 0.145554 Jul 12 13:45:01.268111 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 236/482] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jul 12 13:45:01 2022] POST /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:45:01.274152 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d499a7c1-1752-4c5c-b4c5-18045cd1d086 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:01.274434 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d499a7c1-1752-4c5c-b4c5-18045cd1d086 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:01.281247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d499a7c1-1752-4c5c-b4c5-18045cd1d086 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:01.281697 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d499a7c1-1752-4c5c-b4c5-18045cd1d086 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:01.282942 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d499a7c1-1752-4c5c-b4c5-18045cd1d086 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:01.283386 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d499a7c1-1752-4c5c-b4c5-18045cd1d086 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:01.453115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d499a7c1-1752-4c5c-b4c5-18045cd1d086 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:01.480992 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d499a7c1-1752-4c5c-b4c5-18045cd1d086 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:01.483877 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d499a7c1-1752-4c5c-b4c5-18045cd1d086 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:01.486504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d499a7c1-1752-4c5c-b4c5-18045cd1d086 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1750 microversion: 2.20 time: 0.216957 Jul 12 13:45:01.487075 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 247/483] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:01 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1750 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:02.505069 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e408d39c-2747-4e97-9c8c-2519e6ff7e07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:02.505682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e408d39c-2747-4e97-9c8c-2519e6ff7e07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:02.514133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e408d39c-2747-4e97-9c8c-2519e6ff7e07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:02.515019 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e408d39c-2747-4e97-9c8c-2519e6ff7e07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:02.515376 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e408d39c-2747-4e97-9c8c-2519e6ff7e07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:02.515821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e408d39c-2747-4e97-9c8c-2519e6ff7e07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:02.647399 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e408d39c-2747-4e97-9c8c-2519e6ff7e07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:02.656119 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e408d39c-2747-4e97-9c8c-2519e6ff7e07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:02.657423 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e408d39c-2747-4e97-9c8c-2519e6ff7e07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:02.659073 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e408d39c-2747-4e97-9c8c-2519e6ff7e07 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1752 microversion: 2.20 time: 0.158111 Jul 12 13:45:02.660404 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 237/484] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:02 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:03.679892 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-826de20f-fee8-4506-ac45-a712bf041368 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:03.680414 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-826de20f-fee8-4506-ac45-a712bf041368 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:03.686416 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-826de20f-fee8-4506-ac45-a712bf041368 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:03.686863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-826de20f-fee8-4506-ac45-a712bf041368 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:03.687623 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-826de20f-fee8-4506-ac45-a712bf041368 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:03.688057 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-826de20f-fee8-4506-ac45-a712bf041368 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:03.820780 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-826de20f-fee8-4506-ac45-a712bf041368 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:03.830298 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-826de20f-fee8-4506-ac45-a712bf041368 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:03.832044 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-826de20f-fee8-4506-ac45-a712bf041368 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:03.833209 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-826de20f-fee8-4506-ac45-a712bf041368 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.157964 Jul 12 13:45:03.833766 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 248/485] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:03 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:04.852001 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f9db266c-662e-4452-9588-8552d0c1c6da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:04.852549 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f9db266c-662e-4452-9588-8552d0c1c6da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:04.869420 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f9db266c-662e-4452-9588-8552d0c1c6da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:04.869876 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f9db266c-662e-4452-9588-8552d0c1c6da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:04.870704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f9db266c-662e-4452-9588-8552d0c1c6da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:04.871143 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f9db266c-662e-4452-9588-8552d0c1c6da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:05.144091 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f9db266c-662e-4452-9588-8552d0c1c6da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:05.158231 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f9db266c-662e-4452-9588-8552d0c1c6da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:05.160761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f9db266c-662e-4452-9588-8552d0c1c6da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:05.162551 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f9db266c-662e-4452-9588-8552d0c1c6da tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.314823 Jul 12 13:45:05.163660 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 238/486] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:04 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:06.181268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ac8e39dd-e182-4da1-93b8-d538d3357150 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:06.182567 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ac8e39dd-e182-4da1-93b8-d538d3357150 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:06.191750 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ac8e39dd-e182-4da1-93b8-d538d3357150 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:06.192621 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ac8e39dd-e182-4da1-93b8-d538d3357150 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:06.193878 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ac8e39dd-e182-4da1-93b8-d538d3357150 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:06.194669 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ac8e39dd-e182-4da1-93b8-d538d3357150 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:06.355687 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ac8e39dd-e182-4da1-93b8-d538d3357150 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:06.365303 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ac8e39dd-e182-4da1-93b8-d538d3357150 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:06.367211 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ac8e39dd-e182-4da1-93b8-d538d3357150 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:06.368705 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ac8e39dd-e182-4da1-93b8-d538d3357150 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.191099 Jul 12 13:45:06.369491 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 249/487] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:06 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:07.387624 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-304433ca-1217-48c4-b28e-c06c34b4ac65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:07.388264 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-304433ca-1217-48c4-b28e-c06c34b4ac65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:07.394865 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-304433ca-1217-48c4-b28e-c06c34b4ac65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:07.395314 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-304433ca-1217-48c4-b28e-c06c34b4ac65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:07.396077 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-304433ca-1217-48c4-b28e-c06c34b4ac65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:07.396513 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-304433ca-1217-48c4-b28e-c06c34b4ac65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:07.538749 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-304433ca-1217-48c4-b28e-c06c34b4ac65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:07.549441 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-304433ca-1217-48c4-b28e-c06c34b4ac65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:07.552137 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-304433ca-1217-48c4-b28e-c06c34b4ac65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:07.553635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-304433ca-1217-48c4-b28e-c06c34b4ac65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.169785 Jul 12 13:45:07.554391 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 239/488] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:07 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:08.572292 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1837677d-4b7f-4f44-ae3d-e8e5df7b9c20 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:08.572859 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1837677d-4b7f-4f44-ae3d-e8e5df7b9c20 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:08.579393 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1837677d-4b7f-4f44-ae3d-e8e5df7b9c20 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:08.579844 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1837677d-4b7f-4f44-ae3d-e8e5df7b9c20 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:08.580601 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1837677d-4b7f-4f44-ae3d-e8e5df7b9c20 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:08.581036 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1837677d-4b7f-4f44-ae3d-e8e5df7b9c20 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:08.727063 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1837677d-4b7f-4f44-ae3d-e8e5df7b9c20 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:08.739287 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1837677d-4b7f-4f44-ae3d-e8e5df7b9c20 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:08.741378 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1837677d-4b7f-4f44-ae3d-e8e5df7b9c20 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:08.743033 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1837677d-4b7f-4f44-ae3d-e8e5df7b9c20 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.174696 Jul 12 13:45:08.744069 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 250/489] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:08 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:09.761579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ab6c9d9c-65de-4122-8716-4e7b8e77a49e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:09.762557 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ab6c9d9c-65de-4122-8716-4e7b8e77a49e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:09.780016 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ab6c9d9c-65de-4122-8716-4e7b8e77a49e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:09.780579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ab6c9d9c-65de-4122-8716-4e7b8e77a49e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:09.781448 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ab6c9d9c-65de-4122-8716-4e7b8e77a49e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:09.781988 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ab6c9d9c-65de-4122-8716-4e7b8e77a49e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:09.919453 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ab6c9d9c-65de-4122-8716-4e7b8e77a49e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:09.928361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ab6c9d9c-65de-4122-8716-4e7b8e77a49e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:09.929942 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ab6c9d9c-65de-4122-8716-4e7b8e77a49e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:09.931144 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ab6c9d9c-65de-4122-8716-4e7b8e77a49e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.174229 Jul 12 13:45:09.931706 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 240/490] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:09 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:10.949240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-22c646e5-dbe6-4405-b6a3-c76607425c31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:10.949928 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-22c646e5-dbe6-4405-b6a3-c76607425c31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:10.952454 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=62 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:10.958418 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22c646e5-dbe6-4405-b6a3-c76607425c31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:10.958890 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22c646e5-dbe6-4405-b6a3-c76607425c31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:10.959659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22c646e5-dbe6-4405-b6a3-c76607425c31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:10.960095 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-22c646e5-dbe6-4405-b6a3-c76607425c31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:11.110357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-22c646e5-dbe6-4405-b6a3-c76607425c31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:11.119120 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-22c646e5-dbe6-4405-b6a3-c76607425c31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:11.120611 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-22c646e5-dbe6-4405-b6a3-c76607425c31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:11.121744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-22c646e5-dbe6-4405-b6a3-c76607425c31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.176415 Jul 12 13:45:11.122347 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 251/491] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:10 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:12.140331 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-83fdda36-79a9-4036-a48e-cf4e2b0d4c25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:12.140938 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-83fdda36-79a9-4036-a48e-cf4e2b0d4c25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:12.147491 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83fdda36-79a9-4036-a48e-cf4e2b0d4c25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:12.147947 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83fdda36-79a9-4036-a48e-cf4e2b0d4c25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:12.148720 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83fdda36-79a9-4036-a48e-cf4e2b0d4c25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:12.149158 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-83fdda36-79a9-4036-a48e-cf4e2b0d4c25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:12.291370 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-83fdda36-79a9-4036-a48e-cf4e2b0d4c25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:12.299778 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-83fdda36-79a9-4036-a48e-cf4e2b0d4c25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:12.301299 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-83fdda36-79a9-4036-a48e-cf4e2b0d4c25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:12.303276 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-83fdda36-79a9-4036-a48e-cf4e2b0d4c25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.166881 Jul 12 13:45:12.303833 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 241/492] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:12 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:13.323775 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d5de60dd-2ef5-47fe-962f-35027d5978c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:13.325604 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d5de60dd-2ef5-47fe-962f-35027d5978c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:13.336133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d5de60dd-2ef5-47fe-962f-35027d5978c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:13.337126 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d5de60dd-2ef5-47fe-962f-35027d5978c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:13.338316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d5de60dd-2ef5-47fe-962f-35027d5978c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:13.339332 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d5de60dd-2ef5-47fe-962f-35027d5978c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:13.493283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d5de60dd-2ef5-47fe-962f-35027d5978c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:13.503141 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d5de60dd-2ef5-47fe-962f-35027d5978c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:13.505443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d5de60dd-2ef5-47fe-962f-35027d5978c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:13.506755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d5de60dd-2ef5-47fe-962f-35027d5978c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.189715 Jul 12 13:45:13.517198 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 252/493] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:13 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:14.525015 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0a2c0440-a529-4987-a82f-563a3ad9e40b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:14.525628 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0a2c0440-a529-4987-a82f-563a3ad9e40b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:14.532199 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0a2c0440-a529-4987-a82f-563a3ad9e40b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:14.532653 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0a2c0440-a529-4987-a82f-563a3ad9e40b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:14.533417 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0a2c0440-a529-4987-a82f-563a3ad9e40b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:14.533858 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0a2c0440-a529-4987-a82f-563a3ad9e40b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:14.672693 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0a2c0440-a529-4987-a82f-563a3ad9e40b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:14.675029 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:14.683222 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0a2c0440-a529-4987-a82f-563a3ad9e40b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:14.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0a2c0440-a529-4987-a82f-563a3ad9e40b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:14.686144 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0a2c0440-a529-4987-a82f-563a3ad9e40b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.165558 Jul 12 13:45:14.686695 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 242/494] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:14 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:15.705155 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d39d438d-1aba-4b86-9ef9-a9156a9b30c5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:15.705757 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d39d438d-1aba-4b86-9ef9-a9156a9b30c5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:15.713719 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d39d438d-1aba-4b86-9ef9-a9156a9b30c5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:15.714355 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d39d438d-1aba-4b86-9ef9-a9156a9b30c5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:15.715280 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d39d438d-1aba-4b86-9ef9-a9156a9b30c5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:15.715912 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d39d438d-1aba-4b86-9ef9-a9156a9b30c5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:15.848110 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d39d438d-1aba-4b86-9ef9-a9156a9b30c5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:15.856960 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d39d438d-1aba-4b86-9ef9-a9156a9b30c5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:15.858540 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d39d438d-1aba-4b86-9ef9-a9156a9b30c5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:15.859681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d39d438d-1aba-4b86-9ef9-a9156a9b30c5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.158889 Jul 12 13:45:15.860234 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 253/495] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:15 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:16.878710 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a54e3a42-030d-4a07-b50f-58d6da3dc486 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:16.879328 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a54e3a42-030d-4a07-b50f-58d6da3dc486 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:16.891236 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a54e3a42-030d-4a07-b50f-58d6da3dc486 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:16.892129 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a54e3a42-030d-4a07-b50f-58d6da3dc486 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:16.892921 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a54e3a42-030d-4a07-b50f-58d6da3dc486 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:16.893342 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a54e3a42-030d-4a07-b50f-58d6da3dc486 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:17.024713 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a54e3a42-030d-4a07-b50f-58d6da3dc486 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:17.033364 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a54e3a42-030d-4a07-b50f-58d6da3dc486 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:17.034906 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a54e3a42-030d-4a07-b50f-58d6da3dc486 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:17.036077 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a54e3a42-030d-4a07-b50f-58d6da3dc486 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.161929 Jul 12 13:45:17.036629 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 243/496] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:16 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:18.054186 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b3d4835f-c65c-4372-8c57-958fed32a1e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:18.054732 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b3d4835f-c65c-4372-8c57-958fed32a1e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:18.061204 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3d4835f-c65c-4372-8c57-958fed32a1e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:18.061647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3d4835f-c65c-4372-8c57-958fed32a1e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:18.062429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3d4835f-c65c-4372-8c57-958fed32a1e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:18.062858 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3d4835f-c65c-4372-8c57-958fed32a1e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:18.197509 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b3d4835f-c65c-4372-8c57-958fed32a1e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:18.206268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b3d4835f-c65c-4372-8c57-958fed32a1e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:18.207764 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b3d4835f-c65c-4372-8c57-958fed32a1e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:18.208902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b3d4835f-c65c-4372-8c57-958fed32a1e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.158889 Jul 12 13:45:18.209453 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 254/497] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:18 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:19.228050 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-09e8448d-360b-4354-96d9-79aaf69fb130 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:19.228675 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-09e8448d-360b-4354-96d9-79aaf69fb130 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:19.235194 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09e8448d-360b-4354-96d9-79aaf69fb130 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:19.235642 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09e8448d-360b-4354-96d9-79aaf69fb130 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:19.236406 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09e8448d-360b-4354-96d9-79aaf69fb130 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:19.236858 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09e8448d-360b-4354-96d9-79aaf69fb130 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:19.372343 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-09e8448d-360b-4354-96d9-79aaf69fb130 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:19.380987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-09e8448d-360b-4354-96d9-79aaf69fb130 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:19.382522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-09e8448d-360b-4354-96d9-79aaf69fb130 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:19.383685 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-09e8448d-360b-4354-96d9-79aaf69fb130 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.160114 Jul 12 13:45:19.384276 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 244/498] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:19 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:20.401253 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-92add7b0-ed5a-4dd7-a5af-3678bd5131b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:20.401859 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-92add7b0-ed5a-4dd7-a5af-3678bd5131b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:20.408438 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92add7b0-ed5a-4dd7-a5af-3678bd5131b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:20.408888 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92add7b0-ed5a-4dd7-a5af-3678bd5131b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:20.409646 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92add7b0-ed5a-4dd7-a5af-3678bd5131b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:20.410118 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92add7b0-ed5a-4dd7-a5af-3678bd5131b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:20.568988 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-92add7b0-ed5a-4dd7-a5af-3678bd5131b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:20.578427 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-92add7b0-ed5a-4dd7-a5af-3678bd5131b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:20.579947 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-92add7b0-ed5a-4dd7-a5af-3678bd5131b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:20.581114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-92add7b0-ed5a-4dd7-a5af-3678bd5131b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.183808 Jul 12 13:45:20.581686 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 255/499] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:20 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:21.599401 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c9ac17c0-9cbe-4c1b-9e84-f94b970bab44 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:21.600014 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c9ac17c0-9cbe-4c1b-9e84-f94b970bab44 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:21.607371 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c9ac17c0-9cbe-4c1b-9e84-f94b970bab44 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:21.607822 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c9ac17c0-9cbe-4c1b-9e84-f94b970bab44 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:21.608587 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c9ac17c0-9cbe-4c1b-9e84-f94b970bab44 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:21.609028 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c9ac17c0-9cbe-4c1b-9e84-f94b970bab44 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:21.733925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c9ac17c0-9cbe-4c1b-9e84-f94b970bab44 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:21.742859 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c9ac17c0-9cbe-4c1b-9e84-f94b970bab44 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:21.744379 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c9ac17c0-9cbe-4c1b-9e84-f94b970bab44 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:21.745539 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c9ac17c0-9cbe-4c1b-9e84-f94b970bab44 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.149999 Jul 12 13:45:21.746123 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 245/500] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:21 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:22.763521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4b403124-634e-4117-9e5d-37b23c7432f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:22.764129 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4b403124-634e-4117-9e5d-37b23c7432f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:22.770796 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b403124-634e-4117-9e5d-37b23c7432f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:22.771250 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b403124-634e-4117-9e5d-37b23c7432f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:22.772010 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b403124-634e-4117-9e5d-37b23c7432f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:22.772534 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b403124-634e-4117-9e5d-37b23c7432f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:22.900978 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4b403124-634e-4117-9e5d-37b23c7432f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:22.909674 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4b403124-634e-4117-9e5d-37b23c7432f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:22.911110 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4b403124-634e-4117-9e5d-37b23c7432f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:22.912489 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4b403124-634e-4117-9e5d-37b23c7432f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.153076 Jul 12 13:45:22.913543 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 256/501] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:22 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:45:23.930892 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-814096fc-d1e9-483a-a17e-05aa1af05b3a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:23.931507 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-814096fc-d1e9-483a-a17e-05aa1af05b3a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:23.938082 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-814096fc-d1e9-483a-a17e-05aa1af05b3a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:23.938541 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-814096fc-d1e9-483a-a17e-05aa1af05b3a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:23.939304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-814096fc-d1e9-483a-a17e-05aa1af05b3a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:23.939744 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-814096fc-d1e9-483a-a17e-05aa1af05b3a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:24.073181 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-814096fc-d1e9-483a-a17e-05aa1af05b3a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:24.081648 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-814096fc-d1e9-483a-a17e-05aa1af05b3a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:24.083211 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-814096fc-d1e9-483a-a17e-05aa1af05b3a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:24.084359 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-814096fc-d1e9-483a-a17e-05aa1af05b3a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.157372 Jul 12 13:45:24.084923 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 246/502] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:23 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:25.103605 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-56053bde-0014-4ce7-8425-98b6ace7f1d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:25.104210 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-56053bde-0014-4ce7-8425-98b6ace7f1d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:25.110975 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-56053bde-0014-4ce7-8425-98b6ace7f1d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:25.111459 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-56053bde-0014-4ce7-8425-98b6ace7f1d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:25.112220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-56053bde-0014-4ce7-8425-98b6ace7f1d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:25.112664 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-56053bde-0014-4ce7-8425-98b6ace7f1d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:25.116544 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:25.249380 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-56053bde-0014-4ce7-8425-98b6ace7f1d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:25.258078 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-56053bde-0014-4ce7-8425-98b6ace7f1d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:25.259594 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-56053bde-0014-4ce7-8425-98b6ace7f1d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:25.260746 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-56053bde-0014-4ce7-8425-98b6ace7f1d8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.161593 Jul 12 13:45:25.261472 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 257/503] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:25 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:26.279488 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bf9363e6-debd-4716-8ba6-8838f23e3377 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:26.280103 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bf9363e6-debd-4716-8ba6-8838f23e3377 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:26.286827 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf9363e6-debd-4716-8ba6-8838f23e3377 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:26.287301 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf9363e6-debd-4716-8ba6-8838f23e3377 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:26.288042 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf9363e6-debd-4716-8ba6-8838f23e3377 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:26.288490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf9363e6-debd-4716-8ba6-8838f23e3377 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:26.421682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bf9363e6-debd-4716-8ba6-8838f23e3377 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:26.430881 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bf9363e6-debd-4716-8ba6-8838f23e3377 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:26.432411 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bf9363e6-debd-4716-8ba6-8838f23e3377 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:26.433571 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bf9363e6-debd-4716-8ba6-8838f23e3377 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.158027 Jul 12 13:45:26.434155 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 247/504] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:26 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:27.451885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ef8661eb-34e0-4f41-bd6f-306628ea0a67 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:27.452488 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ef8661eb-34e0-4f41-bd6f-306628ea0a67 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:27.458906 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ef8661eb-34e0-4f41-bd6f-306628ea0a67 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:27.459355 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ef8661eb-34e0-4f41-bd6f-306628ea0a67 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:27.460104 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ef8661eb-34e0-4f41-bd6f-306628ea0a67 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:27.460539 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ef8661eb-34e0-4f41-bd6f-306628ea0a67 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:27.587140 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ef8661eb-34e0-4f41-bd6f-306628ea0a67 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:27.596203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ef8661eb-34e0-4f41-bd6f-306628ea0a67 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:27.597732 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ef8661eb-34e0-4f41-bd6f-306628ea0a67 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:27.598925 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ef8661eb-34e0-4f41-bd6f-306628ea0a67 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.150860 Jul 12 13:45:27.599521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 258/505] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:27 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:28.616836 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e525bf34-7019-45e5-8f85-6b25f7fe2ef0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:28.617473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e525bf34-7019-45e5-8f85-6b25f7fe2ef0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:28.623949 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e525bf34-7019-45e5-8f85-6b25f7fe2ef0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:28.624392 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e525bf34-7019-45e5-8f85-6b25f7fe2ef0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:28.625140 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e525bf34-7019-45e5-8f85-6b25f7fe2ef0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:28.625576 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e525bf34-7019-45e5-8f85-6b25f7fe2ef0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:28.751177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e525bf34-7019-45e5-8f85-6b25f7fe2ef0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:28.760267 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e525bf34-7019-45e5-8f85-6b25f7fe2ef0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:28.761788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e525bf34-7019-45e5-8f85-6b25f7fe2ef0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:28.762968 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e525bf34-7019-45e5-8f85-6b25f7fe2ef0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.150074 Jul 12 13:45:28.763522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 248/506] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:28 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:29.691369 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-b861f22f-6b25-488d-be48-715406efc976 req-02599b8c-08d9-4596-881f-4fc831e980c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d01af-d429-48d6-9f16-6255557bdb67", "name": "network-vif-plugged", "status": "completed", "tag": "35051ab0-4751-427b-ae9e-ddc1611523c0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:45:29.701260 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b861f22f-6b25-488d-be48-715406efc976 req-02599b8c-08d9-4596-881f-4fc831e980c0 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:29.701712 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b861f22f-6b25-488d-be48-715406efc976 req-02599b8c-08d9-4596-881f-4fc831e980c0 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:29.715777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-b861f22f-6b25-488d-be48-715406efc976 req-02599b8c-08d9-4596-881f-4fc831e980c0 service nova] Creating event network-vif-plugged:35051ab0-4751-427b-ae9e-ddc1611523c0 for instance e71d01af-d429-48d6-9f16-6255557bdb67 on hv-cinder-79797 Jul 12 13:45:29.720870 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-b861f22f-6b25-488d-be48-715406efc976 req-02599b8c-08d9-4596-881f-4fc831e980c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033545 Jul 12 13:45:29.721475 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 259/507] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:45:29.780538 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f5fdb702-ff4b-43f5-8d06-fb9b1dc8569d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:29.781138 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f5fdb702-ff4b-43f5-8d06-fb9b1dc8569d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:29.787507 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5fdb702-ff4b-43f5-8d06-fb9b1dc8569d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:29.787948 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5fdb702-ff4b-43f5-8d06-fb9b1dc8569d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:29.788785 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5fdb702-ff4b-43f5-8d06-fb9b1dc8569d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:29.789740 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5fdb702-ff4b-43f5-8d06-fb9b1dc8569d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:29.919816 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f5fdb702-ff4b-43f5-8d06-fb9b1dc8569d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:29.928284 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f5fdb702-ff4b-43f5-8d06-fb9b1dc8569d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:29.929806 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f5fdb702-ff4b-43f5-8d06-fb9b1dc8569d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:29.931004 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f5fdb702-ff4b-43f5-8d06-fb9b1dc8569d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.154327 Jul 12 13:45:29.931564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 249/508] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:29 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:30.949664 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5c7a78f0-a29b-4cc4-aa4f-a481328b282b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:30.950385 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5c7a78f0-a29b-4cc4-aa4f-a481328b282b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:30.956548 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c7a78f0-a29b-4cc4-aa4f-a481328b282b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:30.956996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c7a78f0-a29b-4cc4-aa4f-a481328b282b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:30.957749 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c7a78f0-a29b-4cc4-aa4f-a481328b282b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:30.958225 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5c7a78f0-a29b-4cc4-aa4f-a481328b282b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:31.090428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5c7a78f0-a29b-4cc4-aa4f-a481328b282b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:31.098878 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5c7a78f0-a29b-4cc4-aa4f-a481328b282b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:31.100384 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5c7a78f0-a29b-4cc4-aa4f-a481328b282b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:31.101537 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5c7a78f0-a29b-4cc4-aa4f-a481328b282b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.157060 Jul 12 13:45:31.102114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 260/509] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:30 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:32.119922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-49ac46f3-8cdb-46c8-82df-df7eeb176f10 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:32.120531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-49ac46f3-8cdb-46c8-82df-df7eeb176f10 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:32.122975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=30 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:32.128434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-49ac46f3-8cdb-46c8-82df-df7eeb176f10 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:32.128882 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-49ac46f3-8cdb-46c8-82df-df7eeb176f10 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:32.129642 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-49ac46f3-8cdb-46c8-82df-df7eeb176f10 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:32.130117 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-49ac46f3-8cdb-46c8-82df-df7eeb176f10 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:32.260990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-49ac46f3-8cdb-46c8-82df-df7eeb176f10 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:32.269366 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-49ac46f3-8cdb-46c8-82df-df7eeb176f10 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:32.270914 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-49ac46f3-8cdb-46c8-82df-df7eeb176f10 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:32.272130 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-49ac46f3-8cdb-46c8-82df-df7eeb176f10 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1808 microversion: 2.20 time: 0.156539 Jul 12 13:45:32.272846 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 250/510] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:32 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:33.290565 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6bfe1ea5-d7db-4bec-8490-7c6d1958978c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:33.291102 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6bfe1ea5-d7db-4bec-8490-7c6d1958978c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:33.297596 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6bfe1ea5-d7db-4bec-8490-7c6d1958978c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:33.298090 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6bfe1ea5-d7db-4bec-8490-7c6d1958978c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:33.298862 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6bfe1ea5-d7db-4bec-8490-7c6d1958978c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:33.299304 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6bfe1ea5-d7db-4bec-8490-7c6d1958978c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:33.426784 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6bfe1ea5-d7db-4bec-8490-7c6d1958978c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:33.435751 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6bfe1ea5-d7db-4bec-8490-7c6d1958978c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:33.437266 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6bfe1ea5-d7db-4bec-8490-7c6d1958978c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:33.438460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6bfe1ea5-d7db-4bec-8490-7c6d1958978c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1795 microversion: 2.20 time: 0.152441 Jul 12 13:45:33.439002 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 261/511] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:45:33 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1795 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:45:43.951618 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-916ac62c-24b3-4dd0-af89-b6c5e06c5083 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:43.952317 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-916ac62c-24b3-4dd0-af89-b6c5e06c5083 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:43.954729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:43.955550 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=49 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:43.960436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-916ac62c-24b3-4dd0-af89-b6c5e06c5083 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:43.960888 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-916ac62c-24b3-4dd0-af89-b6c5e06c5083 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:43.961656 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-916ac62c-24b3-4dd0-af89-b6c5e06c5083 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:43.962133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-916ac62c-24b3-4dd0-af89-b6c5e06c5083 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:44.091506 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-916ac62c-24b3-4dd0-af89-b6c5e06c5083 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lazy-loading 'services' on Instance uuid 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:45:44.207834 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-916ac62c-24b3-4dd0-af89-b6c5e06c5083 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/os-volume_attachments/1e7a7297-4274-4888-a918-7cdd234b8e01" status: 202 len: 0 microversion: 2.1 time: 0.259969 Jul 12 13:45:44.208420 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 251/512] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:45:43 2022] DELETE /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/os-volume_attachments/1e7a7297-4274-4888-a918-7cdd234b8e01 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:45:45.325765 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-14e0c3a4-8620-448d-91d7-a53ca62b687c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:45:45.328647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=21 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:45.329379 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=25 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:45.336161 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14e0c3a4-8620-448d-91d7-a53ca62b687c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:45.336640 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14e0c3a4-8620-448d-91d7-a53ca62b687c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:45.359886 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-14e0c3a4-8620-448d-91d7-a53ca62b687c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Going to try to stop instance {{(pid=124466) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 13:45:45.406408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-14e0c3a4-8620-448d-91d7-a53ca62b687c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/action" status: 202 len: 0 microversion: 2.1 time: 0.084618 Jul 12 13:45:45.406950 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 262/513] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:45:45 2022] POST /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:45:45.419788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ea1f0f46-a050-47b2-bd3e-d9649d8992ae tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:45.421176 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ea1f0f46-a050-47b2-bd3e-d9649d8992ae tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:45.431039 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea1f0f46-a050-47b2-bd3e-d9649d8992ae tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:45.431756 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea1f0f46-a050-47b2-bd3e-d9649d8992ae tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:45.432890 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea1f0f46-a050-47b2-bd3e-d9649d8992ae tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:45.433652 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea1f0f46-a050-47b2-bd3e-d9649d8992ae tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:45.572335 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ea1f0f46-a050-47b2-bd3e-d9649d8992ae tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:45.579805 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ea1f0f46-a050-47b2-bd3e-d9649d8992ae tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.167791 Jul 12 13:45:45.580370 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 252/514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:45 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:46.567950 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1070152586", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "networks": [{"uuid": "5e1de4e4-e8bd-4ed5-8403-4e8d8515d177"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:45:46.597810 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3f46b562-f9c6-48d6-baa7-b076a30a1bcf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:46.598441 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3f46b562-f9c6-48d6-baa7-b076a30a1bcf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:46.605391 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f46b562-f9c6-48d6-baa7-b076a30a1bcf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:46.605839 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f46b562-f9c6-48d6-baa7-b076a30a1bcf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:46.606643 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f46b562-f9c6-48d6-baa7-b076a30a1bcf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:46.607072 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f46b562-f9c6-48d6-baa7-b076a30a1bcf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:46.621365 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] validate_networks() for [('5e1de4e4-e8bd-4ed5-8403-4e8d8515d177', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:45:46.734328 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3f46b562-f9c6-48d6-baa7-b076a30a1bcf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:46.742547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3f46b562-f9c6-48d6-baa7-b076a30a1bcf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.147872 Jul 12 13:45:46.743202 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 253/515] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:46 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:45:46.972061 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:45:46.972497 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:45:46.972952 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:45:46.973392 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:45:46.973852 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:45:46.983319 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:46.983699 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:46.984483 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:46.984914 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:47.001510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Getting quotas for project adf5aa6b70414b8f81904a32fa4fa1ab. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:45:47.005645 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Getting quotas for user 1a50af3c7d004e78a99875e1f36a9508 and project adf5aa6b70414b8f81904a32fa4fa1ab. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:45:47.016323 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:45:47.018610 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:45:47.061987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c9de19a4-3eed-41ab-b9fe-995b151b73ce tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498641 Jul 12 13:45:47.062627 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 263/516] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:45:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:45:47.072568 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-649df2b7-bd4f-4d14-bc42-99e530eb8a8f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:47.073177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-649df2b7-bd4f-4d14-bc42-99e530eb8a8f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:47.124685 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-649df2b7-bd4f-4d14-bc42-99e530eb8a8f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:47.132507 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-649df2b7-bd4f-4d14-bc42-99e530eb8a8f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1219 microversion: 2.1 time: 0.063731 Jul 12 13:45:47.133804 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 254/517] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:47 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:47.761119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3f1b3ec8-d6e5-4813-9fbd-b5e5e0f73016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:47.761731 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3f1b3ec8-d6e5-4813-9fbd-b5e5e0f73016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:47.768667 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f1b3ec8-d6e5-4813-9fbd-b5e5e0f73016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:47.769145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f1b3ec8-d6e5-4813-9fbd-b5e5e0f73016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:47.769907 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f1b3ec8-d6e5-4813-9fbd-b5e5e0f73016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:47.770366 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f1b3ec8-d6e5-4813-9fbd-b5e5e0f73016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:47.898172 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3f1b3ec8-d6e5-4813-9fbd-b5e5e0f73016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:47.905680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3f1b3ec8-d6e5-4813-9fbd-b5e5e0f73016 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.149523 Jul 12 13:45:47.906280 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 264/518] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:47 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:48.150531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d5f69af8-3404-4fff-9614-252e334498f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:48.151137 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d5f69af8-3404-4fff-9614-252e334498f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:48.161704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d5f69af8-3404-4fff-9614-252e334498f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:48.162181 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d5f69af8-3404-4fff-9614-252e334498f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:48.162956 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d5f69af8-3404-4fff-9614-252e334498f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:48.163390 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d5f69af8-3404-4fff-9614-252e334498f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:48.239588 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d5f69af8-3404-4fff-9614-252e334498f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:48.247800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d5f69af8-3404-4fff-9614-252e334498f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1289 microversion: 2.1 time: 0.101680 Jul 12 13:45:48.248476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 255/519] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:48 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:48.922685 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-de034097-c7f2-470e-a8c3-0bb589fc286c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:48.923324 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-de034097-c7f2-470e-a8c3-0bb589fc286c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:48.930549 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de034097-c7f2-470e-a8c3-0bb589fc286c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:48.931041 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de034097-c7f2-470e-a8c3-0bb589fc286c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:48.931815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de034097-c7f2-470e-a8c3-0bb589fc286c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:48.932263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de034097-c7f2-470e-a8c3-0bb589fc286c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:49.068021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-de034097-c7f2-470e-a8c3-0bb589fc286c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:49.076892 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-de034097-c7f2-470e-a8c3-0bb589fc286c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.157916 Jul 12 13:45:49.077591 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 265/520] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:48 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:49.264822 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8275e3a3-88a2-4a29-bbe3-32066930b887 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:49.265480 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8275e3a3-88a2-4a29-bbe3-32066930b887 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:49.271968 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8275e3a3-88a2-4a29-bbe3-32066930b887 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:49.272417 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8275e3a3-88a2-4a29-bbe3-32066930b887 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:49.273220 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8275e3a3-88a2-4a29-bbe3-32066930b887 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:49.273656 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8275e3a3-88a2-4a29-bbe3-32066930b887 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:49.472707 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-88df39dd-2e6a-42b5-a11b-c900e2e81b5e req-7e4807a0-8cb7-4886-a5c9-772b52e67e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b06025-d3af-43af-bd55-4d3658abe9bf", "tag": "89229d89-b64d-4a5f-b89f-c94fa25832e9"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:45:49.482637 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-88df39dd-2e6a-42b5-a11b-c900e2e81b5e req-7e4807a0-8cb7-4886-a5c9-772b52e67e61 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:49.483207 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-88df39dd-2e6a-42b5-a11b-c900e2e81b5e req-7e4807a0-8cb7-4886-a5c9-772b52e67e61 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:49.496667 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8275e3a3-88a2-4a29-bbe3-32066930b887 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:49.504265 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-88df39dd-2e6a-42b5-a11b-c900e2e81b5e req-7e4807a0-8cb7-4886-a5c9-772b52e67e61 service nova] Creating event network-changed:89229d89-b64d-4a5f-b89f-c94fa25832e9 for instance a5b06025-d3af-43af-bd55-4d3658abe9bf on hv-cinder-79797 Jul 12 13:45:49.504850 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8275e3a3-88a2-4a29-bbe3-32066930b887 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1319 microversion: 2.1 time: 0.244121 Jul 12 13:45:49.505884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 256/521] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:49 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:49.517829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-88df39dd-2e6a-42b5-a11b-c900e2e81b5e req-7e4807a0-8cb7-4886-a5c9-772b52e67e61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048711 Jul 12 13:45:49.518420 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 266/522] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:45:50.095178 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ea9ee4af-bd42-46b7-ad6c-87482ec51fd1 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:50.095739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ea9ee4af-bd42-46b7-ad6c-87482ec51fd1 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:50.102401 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea9ee4af-bd42-46b7-ad6c-87482ec51fd1 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:50.102849 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea9ee4af-bd42-46b7-ad6c-87482ec51fd1 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:50.103603 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea9ee4af-bd42-46b7-ad6c-87482ec51fd1 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:50.104038 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea9ee4af-bd42-46b7-ad6c-87482ec51fd1 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:50.228484 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ea9ee4af-bd42-46b7-ad6c-87482ec51fd1 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:50.236004 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ea9ee4af-bd42-46b7-ad6c-87482ec51fd1 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.144813 Jul 12 13:45:50.236573 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 257/523] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:50 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:50.524547 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2b669d58-235f-472a-9485-3a7d29f635a9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:50.525310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2b669d58-235f-472a-9485-3a7d29f635a9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:50.531559 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b669d58-235f-472a-9485-3a7d29f635a9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:50.532008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b669d58-235f-472a-9485-3a7d29f635a9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:50.532766 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b669d58-235f-472a-9485-3a7d29f635a9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:50.533205 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b669d58-235f-472a-9485-3a7d29f635a9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:50.661728 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2b669d58-235f-472a-9485-3a7d29f635a9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:50.669143 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2b669d58-235f-472a-9485-3a7d29f635a9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1319 microversion: 2.1 time: 0.149808 Jul 12 13:45:50.669705 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 267/524] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:50 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:51.252751 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3ed563b2-e295-4d5e-b936-ff2deec12c78 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:51.253362 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3ed563b2-e295-4d5e-b936-ff2deec12c78 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:51.259889 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ed563b2-e295-4d5e-b936-ff2deec12c78 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.260345 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ed563b2-e295-4d5e-b936-ff2deec12c78 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.261114 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ed563b2-e295-4d5e-b936-ff2deec12c78 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.261557 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3ed563b2-e295-4d5e-b936-ff2deec12c78 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.656977 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c2fdbb6a-6312-482e-903a-51fb8fbb09c3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:51.657570 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c2fdbb6a-6312-482e-903a-51fb8fbb09c3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:51.663882 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c2fdbb6a-6312-482e-903a-51fb8fbb09c3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.664431 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c2fdbb6a-6312-482e-903a-51fb8fbb09c3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.665749 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c2fdbb6a-6312-482e-903a-51fb8fbb09c3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.666206 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c2fdbb6a-6312-482e-903a-51fb8fbb09c3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.689075 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c2fdbb6a-6312-482e-903a-51fb8fbb09c3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98/ips" status: 200 len: 149 microversion: 2.1 time: 0.035977 Jul 12 13:45:51.689651 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 268/525] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jul 12 13:45:51 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:45:51.694079 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1cce0285-718e-49ad-bd61-5032f540b053 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:51.694705 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1cce0285-718e-49ad-bd61-5032f540b053 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:51.700530 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1cce0285-718e-49ad-bd61-5032f540b053 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.700983 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1cce0285-718e-49ad-bd61-5032f540b053 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.701744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1cce0285-718e-49ad-bd61-5032f540b053 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.702220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1cce0285-718e-49ad-bd61-5032f540b053 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.715009 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3ed563b2-e295-4d5e-b936-ff2deec12c78 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:51.723046 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3ed563b2-e295-4d5e-b936-ff2deec12c78 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.474378 Jul 12 13:45:51.723731 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 258/526] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:51 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:51.737268 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bcbdc7e6-b64a-45d0-b1fc-5357801f3e54 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e79de655-e60f-4b68-a9e6-c72d6f92f4b6"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:45:51.738525 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bcbdc7e6-b64a-45d0-b1fc-5357801f3e54 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:51.744644 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bcbdc7e6-b64a-45d0-b1fc-5357801f3e54 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.745168 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bcbdc7e6-b64a-45d0-b1fc-5357801f3e54 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.746132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bcbdc7e6-b64a-45d0-b1fc-5357801f3e54 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.746578 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bcbdc7e6-b64a-45d0-b1fc-5357801f3e54 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.829102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-bcbdc7e6-b64a-45d0-b1fc-5357801f3e54 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Invalid volume: volume e79de655-e60f-4b68-a9e6-c72d6f92f4b6 is already attached to instances: dedddab8-9a74-4ae7-b88c-9320b24d5440 Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bcbdc7e6-b64a-45d0-b1fc-5357801f3e54 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: POST /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98/os-volume_attachments HTTP/1.1 Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 74 Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:45:51.831451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {"volumeAttachment": {"volumeId": "e79de655-e60f-4b68-a9e6-c72d6f92f4b6"}} Jul 12 13:45:51.833043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Invalid volume: volume e79de655-e60f-4b68-a9e6-c72d6f92f4b6 is already attached to instances: dedddab8-9a74-4ae7-b88c-9320b24d5440 Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'server_id': '95cd2ee8-a4fd-4ff1-90ac-a475974c4f98', 'body': {'volumeAttachment': {'volumeId': 'e79de655-e60f-4b68-a9e6-c72d6f92f4b6'}}} Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e79de655-e60f-4b68-a9e6-c72d6f92f4b6 is already attached to instances: dedddab8-9a74-4ae7-b88c-9320b24d5440 Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:45:51.833946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e79de655-e60f-4b68-a9e6-c72d6f92f4b6 is already attached to instances: dedddab8-9a74-4ae7-b88c-9320b24d5440 Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:45:51.835325 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:45:51.837753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:45:51.837753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:45:51.837753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:45:51.837753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e79de655-e60f-4b68-a9e6-c72d6f92f4b6 is already attached to instances: dedddab8-9a74-4ae7-b88c-9320b24d5440 Jul 12 13:45:51.837753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:45:51.837753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bcbdc7e6-b64a-45d0-b1fc-5357801f3e54 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 400 to user: Invalid volume: volume e79de655-e60f-4b68-a9e6-c72d6f92f4b6 is already attached to instances: dedddab8-9a74-4ae7-b88c-9320b24d5440 {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:45:51.837753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bcbdc7e6-b64a-45d0-b1fc-5357801f3e54 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107772 Jul 12 13:45:51.837753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 259/527] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:45:51 2022] POST /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:45:51.845887 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-004ee138-919a-433f-857e-195562d1f7b6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:51.846494 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-004ee138-919a-433f-857e-195562d1f7b6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:51.853081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1cce0285-718e-49ad-bd61-5032f540b053 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:51.854159 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-004ee138-919a-433f-857e-195562d1f7b6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.854617 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-004ee138-919a-433f-857e-195562d1f7b6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.855676 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-004ee138-919a-433f-857e-195562d1f7b6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.856124 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-004ee138-919a-433f-857e-195562d1f7b6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.863688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1cce0285-718e-49ad-bd61-5032f540b053 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1319 microversion: 2.1 time: 0.172909 Jul 12 13:45:51.864551 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 269/528] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:51 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:51.880979 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-004ee138-919a-433f-857e-195562d1f7b6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:45:51.959850 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-004ee138-919a-433f-857e-195562d1f7b6 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 204 len: 0 microversion: 2.1 time: 0.117799 Jul 12 13:45:51.960358 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 260/529] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:45:51 2022] DELETE /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 13:45:51.969722 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8a861c0b-408c-4576-baca-cf4100932b6d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:51.970371 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8a861c0b-408c-4576-baca-cf4100932b6d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:51.976898 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a861c0b-408c-4576-baca-cf4100932b6d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.977036 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a861c0b-408c-4576-baca-cf4100932b6d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:51.977735 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a861c0b-408c-4576-baca-cf4100932b6d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:51.978226 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8a861c0b-408c-4576-baca-cf4100932b6d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:52.107127 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8a861c0b-408c-4576-baca-cf4100932b6d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:52.114487 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8a861c0b-408c-4576-baca-cf4100932b6d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1681 microversion: 2.1 time: 0.148705 Jul 12 13:45:52.115051 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 270/530] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:51 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:52.741306 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7a7fa340-9f3b-4a98-9578-a5c0032e3ae6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:52.742261 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7a7fa340-9f3b-4a98-9578-a5c0032e3ae6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:52.749171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7a7fa340-9f3b-4a98-9578-a5c0032e3ae6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:52.749616 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7a7fa340-9f3b-4a98-9578-a5c0032e3ae6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:52.750397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7a7fa340-9f3b-4a98-9578-a5c0032e3ae6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:52.750829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7a7fa340-9f3b-4a98-9578-a5c0032e3ae6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:52.878998 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7a7fa340-9f3b-4a98-9578-a5c0032e3ae6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:52.880804 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-75f72315-069d-48dc-8ce1-e66931e297c3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:52.881417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-75f72315-069d-48dc-8ce1-e66931e297c3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:52.886511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7a7fa340-9f3b-4a98-9578-a5c0032e3ae6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.149347 Jul 12 13:45:52.887067 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 261/531] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:52 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:52.888149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-75f72315-069d-48dc-8ce1-e66931e297c3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:52.888662 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-75f72315-069d-48dc-8ce1-e66931e297c3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:52.889438 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-75f72315-069d-48dc-8ce1-e66931e297c3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:52.889885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-75f72315-069d-48dc-8ce1-e66931e297c3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:53.016892 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-75f72315-069d-48dc-8ce1-e66931e297c3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:53.024700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-75f72315-069d-48dc-8ce1-e66931e297c3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1319 microversion: 2.1 time: 0.147967 Jul 12 13:45:53.025260 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 271/532] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:52 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:45:53.131696 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-2a594480-5122-421f-a093-d0b7efc3556a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:53.132338 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-2a594480-5122-421f-a093-d0b7efc3556a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:53.138366 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2a594480-5122-421f-a093-d0b7efc3556a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:53.138832 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2a594480-5122-421f-a093-d0b7efc3556a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:53.139594 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2a594480-5122-421f-a093-d0b7efc3556a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:53.140029 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2a594480-5122-421f-a093-d0b7efc3556a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:53.267436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-2a594480-5122-421f-a093-d0b7efc3556a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:53.275356 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-2a594480-5122-421f-a093-d0b7efc3556a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1681 microversion: 2.1 time: 0.147547 Jul 12 13:45:53.275922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 262/533] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:53 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:53.827938 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-45e23f80-6f29-4fe3-8d5d-bc0bd04fb6ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c220d30-796c-4644-a6d2-2bfdad0a7cdc"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:45:53.828994 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-45e23f80-6f29-4fe3-8d5d-bc0bd04fb6ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:53.834986 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45e23f80-6f29-4fe3-8d5d-bc0bd04fb6ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:53.835429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45e23f80-6f29-4fe3-8d5d-bc0bd04fb6ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:53.836182 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45e23f80-6f29-4fe3-8d5d-bc0bd04fb6ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:53.836617 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-45e23f80-6f29-4fe3-8d5d-bc0bd04fb6ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:53.904242 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-9a5994c8-508b-4f35-87d1-20af3b1696d8 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:53.904881 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-9a5994c8-508b-4f35-87d1-20af3b1696d8 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:53.916228 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9a5994c8-508b-4f35-87d1-20af3b1696d8 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:53.916685 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9a5994c8-508b-4f35-87d1-20af3b1696d8 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:53.917465 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9a5994c8-508b-4f35-87d1-20af3b1696d8 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:53.917905 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9a5994c8-508b-4f35-87d1-20af3b1696d8 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:54.089722 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-45e23f80-6f29-4fe3-8d5d-bc0bd04fb6ec tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265579 Jul 12 13:45:54.090403 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 272/534] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:45:53 2022] POST /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:45:54.098100 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b89bb975-d2b0-46f3-9265-0a1caf985cbf tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:54.098813 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b89bb975-d2b0-46f3-9265-0a1caf985cbf tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:54.106076 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b89bb975-d2b0-46f3-9265-0a1caf985cbf tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:54.106536 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b89bb975-d2b0-46f3-9265-0a1caf985cbf tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:54.108554 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b89bb975-d2b0-46f3-9265-0a1caf985cbf tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:54.108554 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b89bb975-d2b0-46f3-9265-0a1caf985cbf tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:54.275368 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b89bb975-d2b0-46f3-9265-0a1caf985cbf tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:54.283376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b89bb975-d2b0-46f3-9265-0a1caf985cbf tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1319 microversion: 2.1 time: 0.191745 Jul 12 13:45:54.284969 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 273/535] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:54 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:54.291281 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-9a5994c8-508b-4f35-87d1-20af3b1696d8 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:54.298151 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a36731bd-246e-4249-9751-59f336ddbbd1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:54.298995 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a36731bd-246e-4249-9751-59f336ddbbd1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:54.299924 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-9a5994c8-508b-4f35-87d1-20af3b1696d8 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.400283 Jul 12 13:45:54.310109 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a36731bd-246e-4249-9751-59f336ddbbd1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:54.310109 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a36731bd-246e-4249-9751-59f336ddbbd1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:54.310375 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 263/536] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:53 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:45:54.310468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a36731bd-246e-4249-9751-59f336ddbbd1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:54.310468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a36731bd-246e-4249-9751-59f336ddbbd1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:54.448681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a36731bd-246e-4249-9751-59f336ddbbd1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:54.457211 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a36731bd-246e-4249-9751-59f336ddbbd1 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 200 len: 1681 microversion: 2.1 time: 0.166778 Jul 12 13:45:54.458197 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 274/537] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:54 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:45:54.693724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-87b8b8ea-4527-49e0-bf62-b5d804318b59 req-30042a22-4085-464f-bf65-03f727787a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95cd2ee8-a4fd-4ff1-90ac-a475974c4f98", "name": "network-vif-deleted", "tag": "0af76070-e7f5-404e-a34f-bffbaa7ffbfe"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:45:54.703563 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-87b8b8ea-4527-49e0-bf62-b5d804318b59 req-30042a22-4085-464f-bf65-03f727787a33 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:54.704084 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-87b8b8ea-4527-49e0-bf62-b5d804318b59 req-30042a22-4085-464f-bf65-03f727787a33 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:54.718008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-87b8b8ea-4527-49e0-bf62-b5d804318b59 req-30042a22-4085-464f-bf65-03f727787a33 service nova] Creating event network-vif-deleted:0af76070-e7f5-404e-a34f-bffbaa7ffbfe for instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 on hv-cinder-79797 Jul 12 13:45:54.723596 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-87b8b8ea-4527-49e0-bf62-b5d804318b59 req-30042a22-4085-464f-bf65-03f727787a33 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033378 Jul 12 13:45:54.724584 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 264/538] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:45:55.301804 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a3770a86-a605-4ce0-be26-caa5ecdcf775 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:55.302472 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a3770a86-a605-4ce0-be26-caa5ecdcf775 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:55.309659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a3770a86-a605-4ce0-be26-caa5ecdcf775 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:55.310164 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a3770a86-a605-4ce0-be26-caa5ecdcf775 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:55.310930 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a3770a86-a605-4ce0-be26-caa5ecdcf775 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:55.311540 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a3770a86-a605-4ce0-be26-caa5ecdcf775 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:55.317516 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-963c278c-e14e-4669-87f0-c743abbf2e0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:55.318869 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-963c278c-e14e-4669-87f0-c743abbf2e0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:55.328239 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-963c278c-e14e-4669-87f0-c743abbf2e0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:55.328988 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-963c278c-e14e-4669-87f0-c743abbf2e0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:55.330198 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-963c278c-e14e-4669-87f0-c743abbf2e0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:55.330880 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-963c278c-e14e-4669-87f0-c743abbf2e0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:55.480700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a3770a86-a605-4ce0-be26-caa5ecdcf775 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:55.488537 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a3770a86-a605-4ce0-be26-caa5ecdcf775 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1319 microversion: 2.1 time: 0.190679 Jul 12 13:45:55.489729 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 275/539] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:55 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:55.495096 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3f5d2fdd-d44f-48ef-bc29-d71b5dce3269 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:55.495924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3f5d2fdd-d44f-48ef-bc29-d71b5dce3269 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:55.498310 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-963c278c-e14e-4669-87f0-c743abbf2e0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:55.503043 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f5d2fdd-d44f-48ef-bc29-d71b5dce3269 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:55.503864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f5d2fdd-d44f-48ef-bc29-d71b5dce3269 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:55.504702 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f5d2fdd-d44f-48ef-bc29-d71b5dce3269 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:55.505147 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f5d2fdd-d44f-48ef-bc29-d71b5dce3269 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:55.509471 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-963c278c-e14e-4669-87f0-c743abbf2e0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.196350 Jul 12 13:45:55.510307 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 265/540] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:55 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:55.519600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-3f5d2fdd-d44f-48ef-bc29-d71b5dce3269 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3f5d2fdd-d44f-48ef-bc29-d71b5dce3269 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 HTTP/1.1 Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:45:55.521344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:45:55.522920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '95cd2ee8-a4fd-4ff1-90ac-a475974c4f98'} Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:45:55.523857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:45:55.525353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:45:55.530291 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3f5d2fdd-d44f-48ef-bc29-d71b5dce3269 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:45:55.530291 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3f5d2fdd-d44f-48ef-bc29-d71b5dce3269 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 404 len: 111 microversion: 2.1 time: 0.033582 Jul 12 13:45:55.530291 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 276/541] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:55 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:45:55.535993 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0ea3e7c7-a565-40a1-a549-fd0922c57374 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '.version_select at 0x7f3a15bd5f70>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:55.557282 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0ea3e7c7-a565-40a1-a549-fd0922c57374 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228198703" status: 202 len: 0 microversion: 2.1 time: 0.025650 Jul 12 13:45:55.558222 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 266/542] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jul 12 13:45:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228198703 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 13:45:55.774669 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-fd8fc584-1618-4435-8e3d-b156fc8ce7fd req-420f53f9-e100-4f89-8dc5-d5d70e24ec75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b06025-d3af-43af-bd55-4d3658abe9bf", "name": "network-vif-plugged", "status": "completed", "tag": "89229d89-b64d-4a5f-b89f-c94fa25832e9"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:45:55.784266 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-fd8fc584-1618-4435-8e3d-b156fc8ce7fd req-420f53f9-e100-4f89-8dc5-d5d70e24ec75 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:55.784739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-fd8fc584-1618-4435-8e3d-b156fc8ce7fd req-420f53f9-e100-4f89-8dc5-d5d70e24ec75 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:55.805774 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-fd8fc584-1618-4435-8e3d-b156fc8ce7fd req-420f53f9-e100-4f89-8dc5-d5d70e24ec75 service nova] Creating event network-vif-plugged:89229d89-b64d-4a5f-b89f-c94fa25832e9 for instance a5b06025-d3af-43af-bd55-4d3658abe9bf on hv-cinder-79797 Jul 12 13:45:55.815297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-fd8fc584-1618-4435-8e3d-b156fc8ce7fd req-420f53f9-e100-4f89-8dc5-d5d70e24ec75 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044212 Jul 12 13:45:55.819918 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 277/543] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:45:56.315427 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-85239eda-68a9-4316-88c6-08577aeae545 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:56.315921 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-85239eda-68a9-4316-88c6-08577aeae545 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:56.323095 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-85239eda-68a9-4316-88c6-08577aeae545 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:56.323699 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-85239eda-68a9-4316-88c6-08577aeae545 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:56.324298 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-85239eda-68a9-4316-88c6-08577aeae545 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:56.324736 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-85239eda-68a9-4316-88c6-08577aeae545 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:56.402051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:56.406078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-85239eda-68a9-4316-88c6-08577aeae545 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lazy-loading 'services' on Instance uuid dedddab8-9a74-4ae7-b88c-9320b24d5440 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:45:56.478214 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-85239eda-68a9-4316-88c6-08577aeae545 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments/e79de655-e60f-4b68-a9e6-c72d6f92f4b6" status: 202 len: 0 microversion: 2.1 time: 0.166667 Jul 12 13:45:56.478798 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 267/544] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:45:56 2022] DELETE /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments/e79de655-e60f-4b68-a9e6-c72d6f92f4b6 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:45:56.487800 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ba85e732-0179-4871-afe9-9bd60dac375c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:56.488876 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ba85e732-0179-4871-afe9-9bd60dac375c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:56.496156 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ba85e732-0179-4871-afe9-9bd60dac375c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:56.496611 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ba85e732-0179-4871-afe9-9bd60dac375c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:56.497379 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ba85e732-0179-4871-afe9-9bd60dac375c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:56.497818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ba85e732-0179-4871-afe9-9bd60dac375c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:56.506609 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5568ebfe-ed3b-4224-94b6-0c822c792e49 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:56.507590 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5568ebfe-ed3b-4224-94b6-0c822c792e49 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:56.514396 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5568ebfe-ed3b-4224-94b6-0c822c792e49 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:56.515033 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5568ebfe-ed3b-4224-94b6-0c822c792e49 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:56.516017 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5568ebfe-ed3b-4224-94b6-0c822c792e49 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:56.516602 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5568ebfe-ed3b-4224-94b6-0c822c792e49 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:56.528563 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ba85e732-0179-4871-afe9-9bd60dac375c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Jul 12 13:45:56.529132 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 278/545] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:45:56 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:45:56.535941 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-46ce8856-24ea-4c71-9ca1-11f951caf666 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:56.536544 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-46ce8856-24ea-4c71-9ca1-11f951caf666 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:56.543125 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46ce8856-24ea-4c71-9ca1-11f951caf666 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:56.543759 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46ce8856-24ea-4c71-9ca1-11f951caf666 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:56.545209 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46ce8856-24ea-4c71-9ca1-11f951caf666 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:56.545818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46ce8856-24ea-4c71-9ca1-11f951caf666 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:56.550442 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:56.661875 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5568ebfe-ed3b-4224-94b6-0c822c792e49 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:56.670871 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5568ebfe-ed3b-4224-94b6-0c822c792e49 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1319 microversion: 2.1 time: 0.168664 Jul 12 13:45:56.671843 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 268/546] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:56 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:56.692221 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-46ce8856-24ea-4c71-9ca1-11f951caf666 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:56.700333 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-46ce8856-24ea-4c71-9ca1-11f951caf666 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.170159 Jul 12 13:45:56.701033 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 279/547] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:56 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:57.540470 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0be916dd-2cd3-4014-ad08-e810fa7e2a0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:57.541448 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0be916dd-2cd3-4014-ad08-e810fa7e2a0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:57.543410 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:57.549437 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0be916dd-2cd3-4014-ad08-e810fa7e2a0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:57.550071 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0be916dd-2cd3-4014-ad08-e810fa7e2a0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:57.550829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0be916dd-2cd3-4014-ad08-e810fa7e2a0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:57.551267 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0be916dd-2cd3-4014-ad08-e810fa7e2a0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:57.580974 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0be916dd-2cd3-4014-ad08-e810fa7e2a0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Jul 12 13:45:57.581558 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 269/548] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:45:57 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:45:57.688853 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c36bb1e0-83f2-430e-9c27-cf0a81148570 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:57.689397 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c36bb1e0-83f2-430e-9c27-cf0a81148570 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:57.691236 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:57.691880 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:57.698677 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c36bb1e0-83f2-430e-9c27-cf0a81148570 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:57.699123 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c36bb1e0-83f2-430e-9c27-cf0a81148570 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:57.699892 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c36bb1e0-83f2-430e-9c27-cf0a81148570 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:57.700308 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c36bb1e0-83f2-430e-9c27-cf0a81148570 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:57.717544 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ecba1e8b-b2c7-4bbf-866b-682e74b8e45f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:57.718920 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ecba1e8b-b2c7-4bbf-866b-682e74b8e45f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:57.725463 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ecba1e8b-b2c7-4bbf-866b-682e74b8e45f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:57.726205 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ecba1e8b-b2c7-4bbf-866b-682e74b8e45f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:57.727046 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ecba1e8b-b2c7-4bbf-866b-682e74b8e45f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:57.727557 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ecba1e8b-b2c7-4bbf-866b-682e74b8e45f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:57.834861 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c36bb1e0-83f2-430e-9c27-cf0a81148570 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:57.843502 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c36bb1e0-83f2-430e-9c27-cf0a81148570 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1319 microversion: 2.1 time: 0.158288 Jul 12 13:45:57.844689 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 280/549] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:57 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:57.869682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ecba1e8b-b2c7-4bbf-866b-682e74b8e45f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:57.878026 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ecba1e8b-b2c7-4bbf-866b-682e74b8e45f tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.164283 Jul 12 13:45:57.878601 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 270/550] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:57 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:45:58.594372 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d16cf7d3-9852-4b9f-b1e2-bfbee88cccd5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:58.595220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d16cf7d3-9852-4b9f-b1e2-bfbee88cccd5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:58.601210 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d16cf7d3-9852-4b9f-b1e2-bfbee88cccd5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:58.602286 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d16cf7d3-9852-4b9f-b1e2-bfbee88cccd5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:58.603057 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d16cf7d3-9852-4b9f-b1e2-bfbee88cccd5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:58.603500 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d16cf7d3-9852-4b9f-b1e2-bfbee88cccd5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:58.631557 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d16cf7d3-9852-4b9f-b1e2-bfbee88cccd5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042579 Jul 12 13:45:58.632109 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 281/551] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:45:58 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:45:58.861591 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1ccd05f4-fda9-411a-86e3-9623abc84a23 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:58.862238 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1ccd05f4-fda9-411a-86e3-9623abc84a23 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:58.868719 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ccd05f4-fda9-411a-86e3-9623abc84a23 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:58.869166 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ccd05f4-fda9-411a-86e3-9623abc84a23 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:58.869921 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ccd05f4-fda9-411a-86e3-9623abc84a23 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:58.870377 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ccd05f4-fda9-411a-86e3-9623abc84a23 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:58.895352 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-41b24653-49f9-4f1e-9017-a87984f1ac0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:58.895994 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-41b24653-49f9-4f1e-9017-a87984f1ac0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:58.903288 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41b24653-49f9-4f1e-9017-a87984f1ac0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:58.903744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41b24653-49f9-4f1e-9017-a87984f1ac0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:58.904514 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41b24653-49f9-4f1e-9017-a87984f1ac0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:58.904955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41b24653-49f9-4f1e-9017-a87984f1ac0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:59.002490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1ccd05f4-fda9-411a-86e3-9623abc84a23 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:59.010916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1ccd05f4-fda9-411a-86e3-9623abc84a23 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1508 microversion: 2.1 time: 0.153121 Jul 12 13:45:59.011580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 271/552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:58 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:45:59.036082 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-41b24653-49f9-4f1e-9017-a87984f1ac0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:45:59.046673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-41b24653-49f9-4f1e-9017-a87984f1ac0d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.155107 Jul 12 13:45:59.047252 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 282/553] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:45:58 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:45:59.644108 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c6af913a-7bbe-4ab1-8790-2a1e1dc0c849 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:45:59.645052 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c6af913a-7bbe-4ab1-8790-2a1e1dc0c849 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:45:59.651549 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c6af913a-7bbe-4ab1-8790-2a1e1dc0c849 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:59.652006 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c6af913a-7bbe-4ab1-8790-2a1e1dc0c849 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:59.652784 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c6af913a-7bbe-4ab1-8790-2a1e1dc0c849 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:45:59.653228 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c6af913a-7bbe-4ab1-8790-2a1e1dc0c849 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:45:59.684607 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c6af913a-7bbe-4ab1-8790-2a1e1dc0c849 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Jul 12 13:45:59.685173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 272/554] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:45:59 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:00.064243 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-01abbe34-dd2d-47f7-bf15-9eb0e77b67bc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:00.064856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-01abbe34-dd2d-47f7-bf15-9eb0e77b67bc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:00.071545 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01abbe34-dd2d-47f7-bf15-9eb0e77b67bc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:00.072037 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01abbe34-dd2d-47f7-bf15-9eb0e77b67bc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:00.072815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01abbe34-dd2d-47f7-bf15-9eb0e77b67bc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:00.073288 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-01abbe34-dd2d-47f7-bf15-9eb0e77b67bc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:00.204682 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-01abbe34-dd2d-47f7-bf15-9eb0e77b67bc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:00.213050 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-01abbe34-dd2d-47f7-bf15-9eb0e77b67bc tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1676 microversion: 2.1 time: 0.152752 Jul 12 13:46:00.213617 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 283/555] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:00 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:00.697925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d0294bbf-01fa-47b4-97df-faf70e46ed82 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:00.698784 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d0294bbf-01fa-47b4-97df-faf70e46ed82 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:00.705432 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0294bbf-01fa-47b4-97df-faf70e46ed82 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:00.705885 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0294bbf-01fa-47b4-97df-faf70e46ed82 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:00.706680 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0294bbf-01fa-47b4-97df-faf70e46ed82 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:00.707116 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0294bbf-01fa-47b4-97df-faf70e46ed82 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:00.735322 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d0294bbf-01fa-47b4-97df-faf70e46ed82 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042076 Jul 12 13:46:00.735868 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 273/556] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:46:00 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:01.231452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ebbeb8c3-3aca-4d2c-8fc9-7bef09739fe0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:01.231976 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ebbeb8c3-3aca-4d2c-8fc9-7bef09739fe0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:01.238988 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebbeb8c3-3aca-4d2c-8fc9-7bef09739fe0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.239486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebbeb8c3-3aca-4d2c-8fc9-7bef09739fe0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.240329 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebbeb8c3-3aca-4d2c-8fc9-7bef09739fe0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.240795 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ebbeb8c3-3aca-4d2c-8fc9-7bef09739fe0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.379103 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ebbeb8c3-3aca-4d2c-8fc9-7bef09739fe0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:01.388197 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ebbeb8c3-3aca-4d2c-8fc9-7bef09739fe0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1653 microversion: 2.1 time: 0.161331 Jul 12 13:46:01.389082 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 284/557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:01 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1653 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:01.405377 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-27429dc8-1678-462b-92e4-d5f37c475546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:01.412464 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-27429dc8-1678-462b-92e4-d5f37c475546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.413019 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-27429dc8-1678-462b-92e4-d5f37c475546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.435759 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-27429dc8-1678-462b-92e4-d5f37c475546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Going to try to start instance {{(pid=124465) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 13:46:01.483343 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-27429dc8-1678-462b-92e4-d5f37c475546 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/action" status: 202 len: 0 microversion: 2.1 time: 0.081550 Jul 12 13:46:01.483935 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 274/558] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:46:01 2022] POST /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:46:01.492317 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d2506217-d7d9-4d36-8ddb-b874c787c8c7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:01.492921 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d2506217-d7d9-4d36-8ddb-b874c787c8c7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:01.498987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d2506217-d7d9-4d36-8ddb-b874c787c8c7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.499431 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d2506217-d7d9-4d36-8ddb-b874c787c8c7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.500192 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d2506217-d7d9-4d36-8ddb-b874c787c8c7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.500658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d2506217-d7d9-4d36-8ddb-b874c787c8c7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.642856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-47ac0469-b463-4959-a4a3-8eb7e5fc8c0c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:01.643888 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-47ac0469-b463-4959-a4a3-8eb7e5fc8c0c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:01.650862 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-47ac0469-b463-4959-a4a3-8eb7e5fc8c0c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.651315 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-47ac0469-b463-4959-a4a3-8eb7e5fc8c0c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.652091 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-47ac0469-b463-4959-a4a3-8eb7e5fc8c0c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.652541 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-47ac0469-b463-4959-a4a3-8eb7e5fc8c0c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.655395 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d2506217-d7d9-4d36-8ddb-b874c787c8c7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:01.663041 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d2506217-d7d9-4d36-8ddb-b874c787c8c7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1662 microversion: 2.1 time: 0.174762 Jul 12 13:46:01.663608 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 285/559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:01 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1662 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:01.675176 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-47ac0469-b463-4959-a4a3-8eb7e5fc8c0c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lazy-loading 'flavor' on Instance uuid f42ee030-0bf1-402b-b7f4-9c9a33ac5aee {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:46:01.748242 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7ed4b4d7-90c6-475c-8892-cba5d229a94d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:01.749168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7ed4b4d7-90c6-475c-8892-cba5d229a94d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:01.755827 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7ed4b4d7-90c6-475c-8892-cba5d229a94d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.756276 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7ed4b4d7-90c6-475c-8892-cba5d229a94d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.757079 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7ed4b4d7-90c6-475c-8892-cba5d229a94d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.757515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7ed4b4d7-90c6-475c-8892-cba5d229a94d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.794497 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7ed4b4d7-90c6-475c-8892-cba5d229a94d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050348 Jul 12 13:46:01.795061 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 286/560] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:46:01 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:01.814619 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-47ac0469-b463-4959-a4a3-8eb7e5fc8c0c tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/action" status: 200 len: 32 microversion: 2.1 time: 0.175974 Jul 12 13:46:01.815215 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 275/561] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:46:01 2022] POST /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 13:46:01.824651 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-165a7a58-4b23-47c7-909a-3431576a3d82 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:01.825266 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-165a7a58-4b23-47c7-909a-3431576a3d82 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:01.831368 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-165a7a58-4b23-47c7-909a-3431576a3d82 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.831817 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-165a7a58-4b23-47c7-909a-3431576a3d82 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.832791 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-165a7a58-4b23-47c7-909a-3431576a3d82 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:01.833248 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-165a7a58-4b23-47c7-909a-3431576a3d82 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:01.990853 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-165a7a58-4b23-47c7-909a-3431576a3d82 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:02.000444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-165a7a58-4b23-47c7-909a-3431576a3d82 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.179903 Jul 12 13:46:02.009648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 287/562] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:01 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:02.682227 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-535712fd-12b8-4ed8-b2b5-a5dab16a5088 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:02.685648 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-535712fd-12b8-4ed8-b2b5-a5dab16a5088 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:02.692403 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-535712fd-12b8-4ed8-b2b5-a5dab16a5088 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:02.692851 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-535712fd-12b8-4ed8-b2b5-a5dab16a5088 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:02.694141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-535712fd-12b8-4ed8-b2b5-a5dab16a5088 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:02.694974 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-535712fd-12b8-4ed8-b2b5-a5dab16a5088 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:02.806850 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c9f575b6-cac3-4532-9397-c1f5932b3749 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:02.808020 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c9f575b6-cac3-4532-9397-c1f5932b3749 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:02.814487 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9f575b6-cac3-4532-9397-c1f5932b3749 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:02.814947 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9f575b6-cac3-4532-9397-c1f5932b3749 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:02.815718 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9f575b6-cac3-4532-9397-c1f5932b3749 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:02.816162 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9f575b6-cac3-4532-9397-c1f5932b3749 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:02.841941 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-535712fd-12b8-4ed8-b2b5-a5dab16a5088 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:02.848286 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c9f575b6-cac3-4532-9397-c1f5932b3749 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045970 Jul 12 13:46:02.851057 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-535712fd-12b8-4ed8-b2b5-a5dab16a5088 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1662 microversion: 2.1 time: 0.174153 Jul 12 13:46:02.852134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 276/563] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:02 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1662 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:02.858141 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 288/564] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:46:02 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 13:46:02.909638 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8c1aad4c-15f2-4f55-a675-cf5bd68b8f74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:02.910157 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8c1aad4c-15f2-4f55-a675-cf5bd68b8f74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:02.916310 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8c1aad4c-15f2-4f55-a675-cf5bd68b8f74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:02.916757 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8c1aad4c-15f2-4f55-a675-cf5bd68b8f74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:02.917507 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8c1aad4c-15f2-4f55-a675-cf5bd68b8f74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:02.917939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8c1aad4c-15f2-4f55-a675-cf5bd68b8f74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:02.943285 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8c1aad4c-15f2-4f55-a675-cf5bd68b8f74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:46:03.020117 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-16cec3e4-a5be-40bf-bfba-1ced4c05de13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:03.020334 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8c1aad4c-15f2-4f55-a675-cf5bd68b8f74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 204 len: 0 microversion: 2.1 time: 0.113969 Jul 12 13:46:03.021133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-16cec3e4-a5be-40bf-bfba-1ced4c05de13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:03.021412 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 277/565] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:46:02 2022] DELETE /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:46:03.028037 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-16cec3e4-a5be-40bf-bfba-1ced4c05de13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:03.028490 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-16cec3e4-a5be-40bf-bfba-1ced4c05de13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:03.029323 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-16cec3e4-a5be-40bf-bfba-1ced4c05de13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:03.029781 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-16cec3e4-a5be-40bf-bfba-1ced4c05de13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:03.032972 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-82c89d46-f0e3-4f49-8fbf-663a9cb56aa4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:03.033714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-82c89d46-f0e3-4f49-8fbf-663a9cb56aa4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:03.039903 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82c89d46-f0e3-4f49-8fbf-663a9cb56aa4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:03.040354 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82c89d46-f0e3-4f49-8fbf-663a9cb56aa4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:03.041123 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82c89d46-f0e3-4f49-8fbf-663a9cb56aa4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:03.041564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82c89d46-f0e3-4f49-8fbf-663a9cb56aa4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:03.169148 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-16cec3e4-a5be-40bf-bfba-1ced4c05de13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:03.177662 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-16cec3e4-a5be-40bf-bfba-1ced4c05de13 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.161409 Jul 12 13:46:03.178490 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 289/566] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:03 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:03.181184 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-82c89d46-f0e3-4f49-8fbf-663a9cb56aa4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:03.188593 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-82c89d46-f0e3-4f49-8fbf-663a9cb56aa4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1681 microversion: 2.1 time: 0.160825 Jul 12 13:46:03.189139 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 278/567] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:03 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:03.869175 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9260df31-14a6-42b2-8969-06b3f5bc3b8a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:03.869774 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9260df31-14a6-42b2-8969-06b3f5bc3b8a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:03.876201 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9260df31-14a6-42b2-8969-06b3f5bc3b8a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:03.876651 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9260df31-14a6-42b2-8969-06b3f5bc3b8a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:03.877665 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9260df31-14a6-42b2-8969-06b3f5bc3b8a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:03.878141 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9260df31-14a6-42b2-8969-06b3f5bc3b8a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:04.012578 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9260df31-14a6-42b2-8969-06b3f5bc3b8a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:04.020065 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9260df31-14a6-42b2-8969-06b3f5bc3b8a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1662 microversion: 2.1 time: 0.155379 Jul 12 13:46:04.020633 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 290/568] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:03 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:04.195455 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-47bb188d-1876-4787-9244-3da1f0b87fd3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:04.196070 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-47bb188d-1876-4787-9244-3da1f0b87fd3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:04.202781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-47bb188d-1876-4787-9244-3da1f0b87fd3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:04.203237 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-47bb188d-1876-4787-9244-3da1f0b87fd3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:04.204011 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-47bb188d-1876-4787-9244-3da1f0b87fd3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:04.204451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-47bb188d-1876-4787-9244-3da1f0b87fd3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:04.205480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bfbc1d15-9407-4a57-a66f-2203ebf20118 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:04.206145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bfbc1d15-9407-4a57-a66f-2203ebf20118 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:04.208610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:04.212850 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bfbc1d15-9407-4a57-a66f-2203ebf20118 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:04.213301 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bfbc1d15-9407-4a57-a66f-2203ebf20118 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:04.214098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bfbc1d15-9407-4a57-a66f-2203ebf20118 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:04.214543 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bfbc1d15-9407-4a57-a66f-2203ebf20118 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:04.341832 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-47bb188d-1876-4787-9244-3da1f0b87fd3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:04.345246 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bfbc1d15-9407-4a57-a66f-2203ebf20118 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:04.350302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-47bb188d-1876-4787-9244-3da1f0b87fd3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.158964 Jul 12 13:46:04.351033 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 279/569] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:04 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:04.353308 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bfbc1d15-9407-4a57-a66f-2203ebf20118 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1681 microversion: 2.1 time: 0.151594 Jul 12 13:46:04.353874 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 291/570] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:04 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:05.036660 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8db87c1b-bd2d-4c29-bcaa-94dbd66a6c10 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:05.037290 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8db87c1b-bd2d-4c29-bcaa-94dbd66a6c10 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:05.045902 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8db87c1b-bd2d-4c29-bcaa-94dbd66a6c10 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:05.046385 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8db87c1b-bd2d-4c29-bcaa-94dbd66a6c10 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:05.047181 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8db87c1b-bd2d-4c29-bcaa-94dbd66a6c10 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:05.047624 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8db87c1b-bd2d-4c29-bcaa-94dbd66a6c10 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:05.176547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8db87c1b-bd2d-4c29-bcaa-94dbd66a6c10 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:05.184728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8db87c1b-bd2d-4c29-bcaa-94dbd66a6c10 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1666 microversion: 2.1 time: 0.152082 Jul 12 13:46:05.185293 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 280/571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:05 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:05.368998 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-47f9c801-185d-4d6a-9999-af35920270c5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:05.369614 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-47f9c801-185d-4d6a-9999-af35920270c5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:05.370724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-02601d5b-365d-48c7-9733-cc6aff19fa7f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:05.371448 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-02601d5b-365d-48c7-9733-cc6aff19fa7f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:05.377147 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-47f9c801-185d-4d6a-9999-af35920270c5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:05.377147 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-47f9c801-185d-4d6a-9999-af35920270c5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:05.377819 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-47f9c801-185d-4d6a-9999-af35920270c5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:05.378146 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-47f9c801-185d-4d6a-9999-af35920270c5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:05.378664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02601d5b-365d-48c7-9733-cc6aff19fa7f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:05.379118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02601d5b-365d-48c7-9733-cc6aff19fa7f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:05.379899 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02601d5b-365d-48c7-9733-cc6aff19fa7f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:05.380323 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02601d5b-365d-48c7-9733-cc6aff19fa7f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:05.512582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-47f9c801-185d-4d6a-9999-af35920270c5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:05.512745 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-02601d5b-365d-48c7-9733-cc6aff19fa7f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:05.520461 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-02601d5b-365d-48c7-9733-cc6aff19fa7f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1681 microversion: 2.1 time: 0.154241 Jul 12 13:46:05.521218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 281/572] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:05 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:05.521442 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-47f9c801-185d-4d6a-9999-af35920270c5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.156982 Jul 12 13:46:05.528635 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 292/573] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:05 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:06.538689 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c2496a05-2447-4284-b407-105a3e88f21f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:06.539156 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f19129c8-dd3d-4ebe-8f76-de50d606632d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:06.539504 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c2496a05-2447-4284-b407-105a3e88f21f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:06.539607 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f19129c8-dd3d-4ebe-8f76-de50d606632d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:06.545967 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2496a05-2447-4284-b407-105a3e88f21f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:06.546429 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2496a05-2447-4284-b407-105a3e88f21f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:06.546537 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f19129c8-dd3d-4ebe-8f76-de50d606632d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:06.547013 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f19129c8-dd3d-4ebe-8f76-de50d606632d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:06.547187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2496a05-2447-4284-b407-105a3e88f21f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:06.547620 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c2496a05-2447-4284-b407-105a3e88f21f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:06.547975 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f19129c8-dd3d-4ebe-8f76-de50d606632d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:06.548489 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f19129c8-dd3d-4ebe-8f76-de50d606632d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:06.620673 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c2496a05-2447-4284-b407-105a3e88f21f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:06.629276 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c2496a05-2447-4284-b407-105a3e88f21f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 200 len: 1614 microversion: 2.1 time: 0.094505 Jul 12 13:46:06.629846 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 282/574] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:06 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:06.737071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f19129c8-dd3d-4ebe-8f76-de50d606632d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:06.745672 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f19129c8-dd3d-4ebe-8f76-de50d606632d tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.210689 Jul 12 13:46:06.746275 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 293/575] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:06 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:06.898404 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-eff87083-e9de-4d13-8cc5-d9d59888fcf3 req-f9d04f72-c50b-4a8d-a3f5-b24d1bf7be0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dedddab8-9a74-4ae7-b88c-9320b24d5440", "name": "network-vif-deleted", "tag": "321278bd-a4fa-44d4-96f0-489b7d53f4d0"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:06.911783 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-eff87083-e9de-4d13-8cc5-d9d59888fcf3 req-f9d04f72-c50b-4a8d-a3f5-b24d1bf7be0d service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:06.912973 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-eff87083-e9de-4d13-8cc5-d9d59888fcf3 req-f9d04f72-c50b-4a8d-a3f5-b24d1bf7be0d service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:06.933278 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-eff87083-e9de-4d13-8cc5-d9d59888fcf3 req-f9d04f72-c50b-4a8d-a3f5-b24d1bf7be0d service nova] Creating event network-vif-deleted:321278bd-a4fa-44d4-96f0-489b7d53f4d0 for instance dedddab8-9a74-4ae7-b88c-9320b24d5440 on hv-cinder-79797 Jul 12 13:46:06.940688 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-eff87083-e9de-4d13-8cc5-d9d59888fcf3 req-f9d04f72-c50b-4a8d-a3f5-b24d1bf7be0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045482 Jul 12 13:46:06.942056 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 283/576] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:07.647132 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6fdd4b0c-cf79-4104-8644-ef1fb152bdcd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:07.647801 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6fdd4b0c-cf79-4104-8644-ef1fb152bdcd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:07.655497 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6fdd4b0c-cf79-4104-8644-ef1fb152bdcd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:07.656074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6fdd4b0c-cf79-4104-8644-ef1fb152bdcd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:07.656867 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6fdd4b0c-cf79-4104-8644-ef1fb152bdcd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:07.657312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6fdd4b0c-cf79-4104-8644-ef1fb152bdcd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:07.671695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-6fdd4b0c-cf79-4104-8644-ef1fb152bdcd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6fdd4b0c-cf79-4104-8644-ef1fb152bdcd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 HTTP/1.1 Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:46:07.673357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:46:07.674987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'dedddab8-9a74-4ae7-b88c-9320b24d5440'} Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:46:07.675805 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:46:07.677169 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:46:07.678268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6fdd4b0c-cf79-4104-8644-ef1fb152bdcd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:46:07.678268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6fdd4b0c-cf79-4104-8644-ef1fb152bdcd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 404 len: 111 microversion: 2.1 time: 0.031580 Jul 12 13:46:07.678268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 294/577] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:07 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:46:07.685113 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-cb6925ae-456f-4e36-91bd-d1c610db5e10 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '.version_select at 0x7f3a15b9cc10>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:07.708950 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-cb6925ae-456f-4e36-91bd-d1c610db5e10 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679322499" status: 202 len: 0 microversion: 2.1 time: 0.028494 Jul 12 13:46:07.709659 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 284/578] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jul 12 13:46:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679322499 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:46:07.765624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9da13be0-ca56-4200-bc13-a2d4ddee61d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:07.766328 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9da13be0-ca56-4200-bc13-a2d4ddee61d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:07.776535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9da13be0-ca56-4200-bc13-a2d4ddee61d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:07.777021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9da13be0-ca56-4200-bc13-a2d4ddee61d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:07.778468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9da13be0-ca56-4200-bc13-a2d4ddee61d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:07.779266 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9da13be0-ca56-4200-bc13-a2d4ddee61d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:07.976140 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9da13be0-ca56-4200-bc13-a2d4ddee61d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:07.986720 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9da13be0-ca56-4200-bc13-a2d4ddee61d7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.226166 Jul 12 13:46:07.987395 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 295/579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:07 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:08.462373 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f084bb68-0806-46ce-9b60-405fca561274 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: .version_select at 0x7f3a15bd5a60>, body: {"keypair": {"name": "tempest-keypair-2133068301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz6KTD1QvMQhPvDiWzgEIKyQA5QV5uvqa1XPlbNsELRz64ckZZz4JQ7bTy2l9D+8hRt6ItU3W/Sap3NLhO7rQ+5TTVdb9JW2vHkdJTg6gYRxYt4OrlLvW9IdHV3qvw6lQ=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:08.476661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-f084bb68-0806-46ce-9b60-405fca561274 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for project c4e88457b140443093476f9b6d9bcff4. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:46:08.481024 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-f084bb68-0806-46ce-9b60-405fca561274 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for user a892b2511463404c818c63e870a23389 and project c4e88457b140443093476f9b6d9bcff4. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:46:08.503207 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f084bb68-0806-46ce-9b60-405fca561274 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044994 Jul 12 13:46:08.503791 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 285/580] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jul 12 13:46:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:09.005945 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a7312acf-9a85-4ab4-adfa-e73786090091 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:09.006606 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a7312acf-9a85-4ab4-adfa-e73786090091 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:09.013758 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a7312acf-9a85-4ab4-adfa-e73786090091 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:09.014452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a7312acf-9a85-4ab4-adfa-e73786090091 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:09.015423 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a7312acf-9a85-4ab4-adfa-e73786090091 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:09.016034 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a7312acf-9a85-4ab4-adfa-e73786090091 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:09.034081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:09.212959 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a7312acf-9a85-4ab4-adfa-e73786090091 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:09.220957 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a7312acf-9a85-4ab4-adfa-e73786090091 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.219862 Jul 12 13:46:09.221506 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 296/581] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:08 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:09.884032 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-73379422", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0de195dd-d448-4ed3-8684-a2fd07757acb"}], "security_groups": [{"name": "tempest-securitygroup--520278037"}], "key_name": "tempest-keypair-2133068301", "user_data": "}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:09.892461 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:09.988972 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.network.neutron [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] validate_networks() for [('0de195dd-d448-4ed3-8684-a2fd07757acb', None, None, None, None, None)] {{(pid=124465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:46:10.239912 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2a597fc0-14b1-4793-b301-33b132be07b5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:10.240521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2a597fc0-14b1-4793-b301-33b132be07b5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:10.247504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a597fc0-14b1-4793-b301-33b132be07b5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:10.247960 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a597fc0-14b1-4793-b301-33b132be07b5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:10.248735 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a597fc0-14b1-4793-b301-33b132be07b5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:10.249176 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2a597fc0-14b1-4793-b301-33b132be07b5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:10.387187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2a597fc0-14b1-4793-b301-33b132be07b5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:10.395680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2a597fc0-14b1-4793-b301-33b132be07b5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.159682 Jul 12 13:46:10.396274 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 297/582] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:10 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:10.595949 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Flavor limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:46:10.596377 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Image limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:46:10.596851 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Flavor pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:46:10.597261 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Image pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:46:10.597673 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:46:10.607135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:10.607594 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:10.608396 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:10.608838 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:10.626274 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for project c4e88457b140443093476f9b6d9bcff4. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:46:10.630577 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for user a892b2511463404c818c63e870a23389 and project c4e88457b140443093476f9b6d9bcff4. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:46:10.642376 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Going to run 1 instances... {{(pid=124465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:46:10.644772 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:46:10.690973 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-793e5a8b-6c48-41d1-8e37-ada2310965ae tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.812509 Jul 12 13:46:10.691638 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 286/583] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:46:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:46:10.702460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-903fb664-f115-46a7-bdc5-2024f617233d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:10.703256 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-903fb664-f115-46a7-bdc5-2024f617233d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:10.759254 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-903fb664-f115-46a7-bdc5-2024f617233d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:10.766176 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-903fb664-f115-46a7-bdc5-2024f617233d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1240 microversion: 2.1 time: 0.068149 Jul 12 13:46:10.766741 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 298/584] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:10 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:11.413102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-fca6ac13-ef6c-4985-9448-dfd624665a8a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:11.413718 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-fca6ac13-ef6c-4985-9448-dfd624665a8a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:11.420072 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fca6ac13-ef6c-4985-9448-dfd624665a8a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:11.420522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fca6ac13-ef6c-4985-9448-dfd624665a8a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:11.421285 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fca6ac13-ef6c-4985-9448-dfd624665a8a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:11.421724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fca6ac13-ef6c-4985-9448-dfd624665a8a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:11.549235 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-fca6ac13-ef6c-4985-9448-dfd624665a8a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:11.557169 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-fca6ac13-ef6c-4985-9448-dfd624665a8a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.148398 Jul 12 13:46:11.557732 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 287/585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:11 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:11.784182 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3ff903c7-20f6-4f21-99c2-1733303c5487 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:11.784801 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3ff903c7-20f6-4f21-99c2-1733303c5487 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:11.791230 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ff903c7-20f6-4f21-99c2-1733303c5487 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:11.791685 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ff903c7-20f6-4f21-99c2-1733303c5487 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:11.792491 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ff903c7-20f6-4f21-99c2-1733303c5487 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:11.792933 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ff903c7-20f6-4f21-99c2-1733303c5487 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:11.873315 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3ff903c7-20f6-4f21-99c2-1733303c5487 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:11.881153 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3ff903c7-20f6-4f21-99c2-1733303c5487 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1310 microversion: 2.1 time: 0.101320 Jul 12 13:46:11.881750 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 299/586] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:11 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:12.574493 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1bd22816-c370-4930-8e7a-72e6020ab619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:12.575104 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1bd22816-c370-4930-8e7a-72e6020ab619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:12.581682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1bd22816-c370-4930-8e7a-72e6020ab619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:12.582183 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1bd22816-c370-4930-8e7a-72e6020ab619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:12.582951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1bd22816-c370-4930-8e7a-72e6020ab619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:12.583388 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1bd22816-c370-4930-8e7a-72e6020ab619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:12.723906 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1bd22816-c370-4930-8e7a-72e6020ab619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:12.732473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1bd22816-c370-4930-8e7a-72e6020ab619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.161889 Jul 12 13:46:12.733111 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 288/587] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:12 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:12.899946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e943869c-800c-4099-ba7b-99d878a3bdaf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:12.900557 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e943869c-800c-4099-ba7b-99d878a3bdaf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:12.907711 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e943869c-800c-4099-ba7b-99d878a3bdaf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:12.908176 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e943869c-800c-4099-ba7b-99d878a3bdaf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:12.909095 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e943869c-800c-4099-ba7b-99d878a3bdaf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:12.909717 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e943869c-800c-4099-ba7b-99d878a3bdaf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:13.114662 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e943869c-800c-4099-ba7b-99d878a3bdaf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:13.122874 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e943869c-800c-4099-ba7b-99d878a3bdaf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1365 microversion: 2.1 time: 0.227508 Jul 12 13:46:13.123529 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 300/588] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:12 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:13.216582 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-7b04eb1b-d841-45b1-aafe-a45cbb166137 req-c09b5d5c-4ae5-4f94-9d14-490b10e5abf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84876f50-f017-42db-8784-05787e987508", "tag": "cd8b2ad0-77dc-4353-9c90-05d7f2a4da54"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:13.226225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-7b04eb1b-d841-45b1-aafe-a45cbb166137 req-c09b5d5c-4ae5-4f94-9d14-490b10e5abf3 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:13.226832 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-7b04eb1b-d841-45b1-aafe-a45cbb166137 req-c09b5d5c-4ae5-4f94-9d14-490b10e5abf3 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:13.239382 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-7b04eb1b-d841-45b1-aafe-a45cbb166137 req-c09b5d5c-4ae5-4f94-9d14-490b10e5abf3 service nova] Creating event network-changed:cd8b2ad0-77dc-4353-9c90-05d7f2a4da54 for instance 84876f50-f017-42db-8784-05787e987508 on hv-cinder-79797 Jul 12 13:46:13.244953 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-7b04eb1b-d841-45b1-aafe-a45cbb166137 req-c09b5d5c-4ae5-4f94-9d14-490b10e5abf3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037389 Jul 12 13:46:13.246009 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 289/589] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:13.749900 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7b35279e-a288-41a2-951e-b68352396b0a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:13.750537 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7b35279e-a288-41a2-951e-b68352396b0a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:13.756825 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b35279e-a288-41a2-951e-b68352396b0a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:13.757303 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b35279e-a288-41a2-951e-b68352396b0a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:13.758102 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b35279e-a288-41a2-951e-b68352396b0a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:13.758545 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b35279e-a288-41a2-951e-b68352396b0a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:13.884312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7b35279e-a288-41a2-951e-b68352396b0a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:13.892030 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7b35279e-a288-41a2-951e-b68352396b0a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.145982 Jul 12 13:46:13.892591 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 301/590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:13 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:14.142400 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8098018b-93e0-4b86-bd86-ef539cd6db91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:14.143103 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8098018b-93e0-4b86-bd86-ef539cd6db91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:14.149944 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8098018b-93e0-4b86-bd86-ef539cd6db91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:14.150418 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8098018b-93e0-4b86-bd86-ef539cd6db91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:14.151191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8098018b-93e0-4b86-bd86-ef539cd6db91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:14.151628 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8098018b-93e0-4b86-bd86-ef539cd6db91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:14.279859 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8098018b-93e0-4b86-bd86-ef539cd6db91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:14.287189 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8098018b-93e0-4b86-bd86-ef539cd6db91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1365 microversion: 2.1 time: 0.149590 Jul 12 13:46:14.287758 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 290/591] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:14 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:14.908520 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-877c486e-ac43-4a86-b80b-e353a8e8b4a9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:14.909125 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-877c486e-ac43-4a86-b80b-e353a8e8b4a9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:14.916265 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-877c486e-ac43-4a86-b80b-e353a8e8b4a9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:14.916712 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-877c486e-ac43-4a86-b80b-e353a8e8b4a9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:14.917477 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-877c486e-ac43-4a86-b80b-e353a8e8b4a9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:14.917919 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-877c486e-ac43-4a86-b80b-e353a8e8b4a9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:15.304793 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1a9bae0e-2616-4929-b91f-3d6d2badb143 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:15.305413 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1a9bae0e-2616-4929-b91f-3d6d2badb143 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:15.312070 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a9bae0e-2616-4929-b91f-3d6d2badb143 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:15.312533 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a9bae0e-2616-4929-b91f-3d6d2badb143 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:15.313313 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a9bae0e-2616-4929-b91f-3d6d2badb143 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:15.313755 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a9bae0e-2616-4929-b91f-3d6d2badb143 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:15.348709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-877c486e-ac43-4a86-b80b-e353a8e8b4a9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:15.356671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-877c486e-ac43-4a86-b80b-e353a8e8b4a9 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.451949 Jul 12 13:46:15.357569 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 302/592] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:14 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:15.451686 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1a9bae0e-2616-4929-b91f-3d6d2badb143 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:15.459236 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1a9bae0e-2616-4929-b91f-3d6d2badb143 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1365 microversion: 2.1 time: 0.158375 Jul 12 13:46:15.461353 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 291/593] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:15 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:16.287065 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-14551c1e-32e2-4f17-af6a-84aa616338fe tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f010691-92cc-44e2-8570-4a212e38ee47", "device": "/dev/sdb"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:16.288681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-14551c1e-32e2-4f17-af6a-84aa616338fe tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:16.291680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:16.297145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14551c1e-32e2-4f17-af6a-84aa616338fe tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:16.297603 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14551c1e-32e2-4f17-af6a-84aa616338fe tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:16.298409 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14551c1e-32e2-4f17-af6a-84aa616338fe tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:16.298850 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14551c1e-32e2-4f17-af6a-84aa616338fe tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:16.374086 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-62e428eb-5d26-446d-b879-bffccc46fa0b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:16.374840 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-62e428eb-5d26-446d-b879-bffccc46fa0b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:16.382198 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-62e428eb-5d26-446d-b879-bffccc46fa0b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:16.382723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-62e428eb-5d26-446d-b879-bffccc46fa0b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:16.383478 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-62e428eb-5d26-446d-b879-bffccc46fa0b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:16.383912 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-62e428eb-5d26-446d-b879-bffccc46fa0b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:16.521155 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-62e428eb-5d26-446d-b879-bffccc46fa0b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:16.529874 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-62e428eb-5d26-446d-b879-bffccc46fa0b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.159489 Jul 12 13:46:16.530921 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 292/594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:16 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:16.536089 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-fedcf1b4-7b4b-41c2-91e4-ba758321a819 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:16.536702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-fedcf1b4-7b4b-41c2-91e4-ba758321a819 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:16.543374 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fedcf1b4-7b4b-41c2-91e4-ba758321a819 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:16.543829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fedcf1b4-7b4b-41c2-91e4-ba758321a819 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:16.544603 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fedcf1b4-7b4b-41c2-91e4-ba758321a819 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:16.545044 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fedcf1b4-7b4b-41c2-91e4-ba758321a819 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:16.547408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-14551c1e-32e2-4f17-af6a-84aa616338fe tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "POST /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263993 Jul 12 13:46:16.547910 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 303/595] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:46:16 2022] POST /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:16.679671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-fedcf1b4-7b4b-41c2-91e4-ba758321a819 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:16.687161 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-fedcf1b4-7b4b-41c2-91e4-ba758321a819 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1365 microversion: 2.1 time: 0.155247 Jul 12 13:46:16.687729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 293/596] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:16 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:17.548173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c12b52f4-619c-4224-bd3c-6d87edcf6693 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:17.548881 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c12b52f4-619c-4224-bd3c-6d87edcf6693 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:17.555657 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c12b52f4-619c-4224-bd3c-6d87edcf6693 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:17.556107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c12b52f4-619c-4224-bd3c-6d87edcf6693 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:17.557537 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c12b52f4-619c-4224-bd3c-6d87edcf6693 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:17.558023 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c12b52f4-619c-4224-bd3c-6d87edcf6693 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:17.687910 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c12b52f4-619c-4224-bd3c-6d87edcf6693 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:17.695870 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c12b52f4-619c-4224-bd3c-6d87edcf6693 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.151861 Jul 12 13:46:17.696438 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 304/597] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:17 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:17.704080 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3326caa1-dc1c-4d67-af3a-94314daedb83 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:17.704696 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3326caa1-dc1c-4d67-af3a-94314daedb83 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:17.711319 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3326caa1-dc1c-4d67-af3a-94314daedb83 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:17.711711 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3326caa1-dc1c-4d67-af3a-94314daedb83 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:17.712988 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3326caa1-dc1c-4d67-af3a-94314daedb83 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:17.713688 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3326caa1-dc1c-4d67-af3a-94314daedb83 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:17.845485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3326caa1-dc1c-4d67-af3a-94314daedb83 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:17.854485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3326caa1-dc1c-4d67-af3a-94314daedb83 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1365 microversion: 2.1 time: 0.153303 Jul 12 13:46:17.855161 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 294/598] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:17 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:18.712657 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8690ce65-65fe-4c85-b35c-cc33eef7d053 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:18.713238 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8690ce65-65fe-4c85-b35c-cc33eef7d053 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:18.719761 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8690ce65-65fe-4c85-b35c-cc33eef7d053 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:18.720214 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8690ce65-65fe-4c85-b35c-cc33eef7d053 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:18.720985 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8690ce65-65fe-4c85-b35c-cc33eef7d053 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:18.721426 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8690ce65-65fe-4c85-b35c-cc33eef7d053 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:18.849812 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8690ce65-65fe-4c85-b35c-cc33eef7d053 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:18.858378 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8690ce65-65fe-4c85-b35c-cc33eef7d053 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.149556 Jul 12 13:46:18.858942 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 305/599] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:18 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:18.871572 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7861a84e-a4e1-4c25-bfc0-2539fcb536ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:18.872176 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7861a84e-a4e1-4c25-bfc0-2539fcb536ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:18.878863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7861a84e-a4e1-4c25-bfc0-2539fcb536ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:18.879307 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7861a84e-a4e1-4c25-bfc0-2539fcb536ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:18.880059 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7861a84e-a4e1-4c25-bfc0-2539fcb536ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:18.880487 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7861a84e-a4e1-4c25-bfc0-2539fcb536ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:19.005806 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7861a84e-a4e1-4c25-bfc0-2539fcb536ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:19.013170 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7861a84e-a4e1-4c25-bfc0-2539fcb536ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1365 microversion: 2.1 time: 0.146044 Jul 12 13:46:19.013737 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 295/600] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:18 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:19.875296 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6b93dfee-3044-418f-9264-84fff4dc8403 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:19.875987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6b93dfee-3044-418f-9264-84fff4dc8403 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:19.883582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b93dfee-3044-418f-9264-84fff4dc8403 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:19.884043 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b93dfee-3044-418f-9264-84fff4dc8403 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:19.884923 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-1bcc0f86-ca28-41fa-a8e2-fb07cd6f86ab req-083f4fab-4399-4318-bc15-86844f859132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84876f50-f017-42db-8784-05787e987508", "name": "network-vif-plugged", "status": "completed", "tag": "cd8b2ad0-77dc-4353-9c90-05d7f2a4da54"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:19.885384 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b93dfee-3044-418f-9264-84fff4dc8403 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:19.885751 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b93dfee-3044-418f-9264-84fff4dc8403 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:19.900536 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-1bcc0f86-ca28-41fa-a8e2-fb07cd6f86ab req-083f4fab-4399-4318-bc15-86844f859132 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:19.900536 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-1bcc0f86-ca28-41fa-a8e2-fb07cd6f86ab req-083f4fab-4399-4318-bc15-86844f859132 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:19.911377 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-1bcc0f86-ca28-41fa-a8e2-fb07cd6f86ab req-083f4fab-4399-4318-bc15-86844f859132 service nova] Creating event network-vif-plugged:cd8b2ad0-77dc-4353-9c90-05d7f2a4da54 for instance 84876f50-f017-42db-8784-05787e987508 on hv-cinder-79797 Jul 12 13:46:19.917417 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-1bcc0f86-ca28-41fa-a8e2-fb07cd6f86ab req-083f4fab-4399-4318-bc15-86844f859132 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036976 Jul 12 13:46:19.918277 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 296/601] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:46:20.031547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b39de8ff-65dd-4354-9a81-acd13b2ad586 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:20.032260 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b39de8ff-65dd-4354-9a81-acd13b2ad586 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:20.038591 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b39de8ff-65dd-4354-9a81-acd13b2ad586 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:20.038829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6b93dfee-3044-418f-9264-84fff4dc8403 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:20.039048 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b39de8ff-65dd-4354-9a81-acd13b2ad586 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:20.039832 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b39de8ff-65dd-4354-9a81-acd13b2ad586 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:20.040273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b39de8ff-65dd-4354-9a81-acd13b2ad586 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:20.047282 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6b93dfee-3044-418f-9264-84fff4dc8403 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.175778 Jul 12 13:46:20.047861 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 306/602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:19 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:20.170154 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b39de8ff-65dd-4354-9a81-acd13b2ad586 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:20.177534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b39de8ff-65dd-4354-9a81-acd13b2ad586 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1365 microversion: 2.1 time: 0.150919 Jul 12 13:46:20.178128 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 297/603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:20 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:21.064620 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8f54d266-3366-4003-8d88-4f2a7e808f4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:21.065238 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8f54d266-3366-4003-8d88-4f2a7e808f4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:21.067231 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:21.073683 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f54d266-3366-4003-8d88-4f2a7e808f4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:21.074174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f54d266-3366-4003-8d88-4f2a7e808f4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:21.074948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f54d266-3366-4003-8d88-4f2a7e808f4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:21.075393 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f54d266-3366-4003-8d88-4f2a7e808f4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:21.194994 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f5039028-4b5b-4b80-a9a1-7bd3cd5f79da tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:21.195647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f5039028-4b5b-4b80-a9a1-7bd3cd5f79da tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:21.198104 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:21.198768 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=10 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:21.205787 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5039028-4b5b-4b80-a9a1-7bd3cd5f79da tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:21.206269 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5039028-4b5b-4b80-a9a1-7bd3cd5f79da tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:21.207051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5039028-4b5b-4b80-a9a1-7bd3cd5f79da tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:21.207526 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f5039028-4b5b-4b80-a9a1-7bd3cd5f79da tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:21.213835 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-8f54d266-3366-4003-8d88-4f2a7e808f4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:21.222422 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8f54d266-3366-4003-8d88-4f2a7e808f4b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.161631 Jul 12 13:46:21.223317 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 307/604] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:21 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:21.347761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f5039028-4b5b-4b80-a9a1-7bd3cd5f79da tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:21.355200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f5039028-4b5b-4b80-a9a1-7bd3cd5f79da tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1365 microversion: 2.1 time: 0.164207 Jul 12 13:46:21.355761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 298/605] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:21 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:21.745447 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-24935b8b-720a-4794-9334-6e114c4f7cbd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:21.745941 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-24935b8b-720a-4794-9334-6e114c4f7cbd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:21.752247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-24935b8b-720a-4794-9334-6e114c4f7cbd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:21.752700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-24935b8b-720a-4794-9334-6e114c4f7cbd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:21.753457 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-24935b8b-720a-4794-9334-6e114c4f7cbd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:21.753894 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-24935b8b-720a-4794-9334-6e114c4f7cbd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:21.784089 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-24935b8b-720a-4794-9334-6e114c4f7cbd tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments/c254755f-f20e-4c48-a6a1-4773ab5ccd55" status: 200 len: 194 microversion: 2.20 time: 0.043224 Jul 12 13:46:21.784658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 308/606] 10.222.0.52 () {60 vars in 1453 bytes} [Tue Jul 12 13:46:21 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments/c254755f-f20e-4c48-a6a1-4773ab5ccd55 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:46:21.847977 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-057b014b-9fad-4a2d-93be-7a29cd7bd239 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:21.848656 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-057b014b-9fad-4a2d-93be-7a29cd7bd239 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:21.855261 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-057b014b-9fad-4a2d-93be-7a29cd7bd239 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:21.855718 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-057b014b-9fad-4a2d-93be-7a29cd7bd239 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:21.856609 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-057b014b-9fad-4a2d-93be-7a29cd7bd239 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:21.857052 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-057b014b-9fad-4a2d-93be-7a29cd7bd239 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:21.942302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-057b014b-9fad-4a2d-93be-7a29cd7bd239 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lazy-loading 'services' on Instance uuid e71d01af-d429-48d6-9f16-6255557bdb67 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:46:22.002739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:22.013206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-057b014b-9fad-4a2d-93be-7a29cd7bd239 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments/c254755f-f20e-4c48-a6a1-4773ab5ccd55" status: 202 len: 0 microversion: 2.20 time: 0.171436 Jul 12 13:46:22.013786 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 299/607] 10.222.0.52 () {60 vars in 1456 bytes} [Tue Jul 12 13:46:21 2022] DELETE /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments/c254755f-f20e-4c48-a6a1-4773ab5ccd55 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:46:22.022093 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-82411ec4-cc96-410e-b22c-013ccd266779 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:22.023065 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-82411ec4-cc96-410e-b22c-013ccd266779 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:22.028960 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-82411ec4-cc96-410e-b22c-013ccd266779 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:22.029410 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-82411ec4-cc96-410e-b22c-013ccd266779 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:22.030196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-82411ec4-cc96-410e-b22c-013ccd266779 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:22.030631 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-82411ec4-cc96-410e-b22c-013ccd266779 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:22.059883 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-82411ec4-cc96-410e-b22c-013ccd266779 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041734 Jul 12 13:46:22.060437 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 309/608] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jul 12 13:46:22 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:46:22.241045 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-fd583042-7009-40cf-92de-a80fe0cd31f2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:22.241766 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-fd583042-7009-40cf-92de-a80fe0cd31f2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:22.248169 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fd583042-7009-40cf-92de-a80fe0cd31f2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:22.248562 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fd583042-7009-40cf-92de-a80fe0cd31f2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:22.249330 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fd583042-7009-40cf-92de-a80fe0cd31f2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:22.249770 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fd583042-7009-40cf-92de-a80fe0cd31f2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:22.371924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-15d64de7-0fd4-411f-8be9-c162ec8d1306 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:22.372651 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-15d64de7-0fd4-411f-8be9-c162ec8d1306 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:22.379521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-15d64de7-0fd4-411f-8be9-c162ec8d1306 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:22.380044 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-15d64de7-0fd4-411f-8be9-c162ec8d1306 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:22.380336 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-fd583042-7009-40cf-92de-a80fe0cd31f2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:22.380943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-15d64de7-0fd4-411f-8be9-c162ec8d1306 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:22.381464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-15d64de7-0fd4-411f-8be9-c162ec8d1306 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:22.388731 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-fd583042-7009-40cf-92de-a80fe0cd31f2 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.152838 Jul 12 13:46:22.389435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 300/609] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:22 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:22.509875 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-15d64de7-0fd4-411f-8be9-c162ec8d1306 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:22.517306 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-15d64de7-0fd4-411f-8be9-c162ec8d1306 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1554 microversion: 2.1 time: 0.149350 Jul 12 13:46:22.517874 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 310/610] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:22 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:22.533683 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-13cc5d85-6e67-425b-815e-9eb190ca5a01 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:22.534209 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-13cc5d85-6e67-425b-815e-9eb190ca5a01 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:22.540130 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-13cc5d85-6e67-425b-815e-9eb190ca5a01 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:22.541276 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-13cc5d85-6e67-425b-815e-9eb190ca5a01 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:22.542074 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-13cc5d85-6e67-425b-815e-9eb190ca5a01 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:22.542517 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-13cc5d85-6e67-425b-815e-9eb190ca5a01 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:22.619837 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-13cc5d85-6e67-425b-815e-9eb190ca5a01 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089884 Jul 12 13:46:22.620429 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 301/611] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jul 12 13:46:22 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:23.073862 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cd883139-78f9-4d72-84a9-ba085277c46e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:23.074900 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cd883139-78f9-4d72-84a9-ba085277c46e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:23.081114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cd883139-78f9-4d72-84a9-ba085277c46e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:23.081644 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cd883139-78f9-4d72-84a9-ba085277c46e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:23.082508 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cd883139-78f9-4d72-84a9-ba085277c46e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:23.083018 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cd883139-78f9-4d72-84a9-ba085277c46e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:23.113562 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cd883139-78f9-4d72-84a9-ba085277c46e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044233 Jul 12 13:46:23.114392 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 311/612] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jul 12 13:46:23 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:46:23.407266 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6a65a350-1b20-4c44-a0c9-4acc627a0667 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:23.407887 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6a65a350-1b20-4c44-a0c9-4acc627a0667 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:23.414000 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6a65a350-1b20-4c44-a0c9-4acc627a0667 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:23.414458 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6a65a350-1b20-4c44-a0c9-4acc627a0667 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:23.415236 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6a65a350-1b20-4c44-a0c9-4acc627a0667 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:23.415712 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6a65a350-1b20-4c44-a0c9-4acc627a0667 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:23.628873 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6a65a350-1b20-4c44-a0c9-4acc627a0667 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:23.639883 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-fe448481-438a-4aa6-b06d-f5e40a1333d8 req-d8583d78-8ce9-4ec5-912d-70aea28cfa34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84876f50-f017-42db-8784-05787e987508", "tag": "cd8b2ad0-77dc-4353-9c90-05d7f2a4da54"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:23.640759 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6a65a350-1b20-4c44-a0c9-4acc627a0667 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.237693 Jul 12 13:46:23.650945 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 302/613] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:23 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:23.651118 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-fe448481-438a-4aa6-b06d-f5e40a1333d8 req-d8583d78-8ce9-4ec5-912d-70aea28cfa34 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:23.651118 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-fe448481-438a-4aa6-b06d-f5e40a1333d8 req-d8583d78-8ce9-4ec5-912d-70aea28cfa34 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:23.660196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-fe448481-438a-4aa6-b06d-f5e40a1333d8 req-d8583d78-8ce9-4ec5-912d-70aea28cfa34 service nova] Creating event network-changed:cd8b2ad0-77dc-4353-9c90-05d7f2a4da54 for instance 84876f50-f017-42db-8784-05787e987508 on hv-cinder-79797 Jul 12 13:46:23.665113 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-fe448481-438a-4aa6-b06d-f5e40a1333d8 req-d8583d78-8ce9-4ec5-912d-70aea28cfa34 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028855 Jul 12 13:46:23.665743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 312/614] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:46:24.125747 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6601d02c-4767-4aae-8cde-d2704bac382e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:24.127155 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6601d02c-4767-4aae-8cde-d2704bac382e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:24.133309 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6601d02c-4767-4aae-8cde-d2704bac382e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:24.134102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6601d02c-4767-4aae-8cde-d2704bac382e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:24.135153 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6601d02c-4767-4aae-8cde-d2704bac382e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:24.135791 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6601d02c-4767-4aae-8cde-d2704bac382e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:24.167413 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6601d02c-4767-4aae-8cde-d2704bac382e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045815 Jul 12 13:46:24.168123 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 303/615] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jul 12 13:46:24 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:46:24.659735 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-57ddd5d4-baa3-416d-9b65-da3c859b2163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:24.660371 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-57ddd5d4-baa3-416d-9b65-da3c859b2163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:24.667653 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-57ddd5d4-baa3-416d-9b65-da3c859b2163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:24.668098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-57ddd5d4-baa3-416d-9b65-da3c859b2163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:24.668876 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-57ddd5d4-baa3-416d-9b65-da3c859b2163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:24.669316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-57ddd5d4-baa3-416d-9b65-da3c859b2163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:24.688284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:24.806674 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-57ddd5d4-baa3-416d-9b65-da3c859b2163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:24.814684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-57ddd5d4-baa3-416d-9b65-da3c859b2163 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.159742 Jul 12 13:46:24.815863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 313/616] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:24 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:25.180423 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b1bdc0ed-2b41-466d-9e2a-06317bb3521f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:25.181863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b1bdc0ed-2b41-466d-9e2a-06317bb3521f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:25.188582 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1bdc0ed-2b41-466d-9e2a-06317bb3521f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:25.189026 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1bdc0ed-2b41-466d-9e2a-06317bb3521f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:25.189773 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1bdc0ed-2b41-466d-9e2a-06317bb3521f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:25.190236 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b1bdc0ed-2b41-466d-9e2a-06317bb3521f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:25.218756 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b1bdc0ed-2b41-466d-9e2a-06317bb3521f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042320 Jul 12 13:46:25.219304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 304/617] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jul 12 13:46:25 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:46:25.832656 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3553b150-d191-47af-8127-70c4ea839ba0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:25.833195 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3553b150-d191-47af-8127-70c4ea839ba0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:25.839671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3553b150-d191-47af-8127-70c4ea839ba0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:25.840119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3553b150-d191-47af-8127-70c4ea839ba0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:25.840879 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3553b150-d191-47af-8127-70c4ea839ba0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:25.841314 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3553b150-d191-47af-8127-70c4ea839ba0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:25.974373 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3553b150-d191-47af-8127-70c4ea839ba0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:25.983010 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3553b150-d191-47af-8127-70c4ea839ba0 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.154284 Jul 12 13:46:25.983585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 314/618] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:25 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:26.231001 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a57bdd15-1667-419c-8061-1461500f28a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:26.231909 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a57bdd15-1667-419c-8061-1461500f28a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:26.238349 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a57bdd15-1667-419c-8061-1461500f28a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:26.238798 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a57bdd15-1667-419c-8061-1461500f28a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:26.239549 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a57bdd15-1667-419c-8061-1461500f28a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:26.239978 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a57bdd15-1667-419c-8061-1461500f28a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:26.267920 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a57bdd15-1667-419c-8061-1461500f28a6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041509 Jul 12 13:46:26.268458 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 305/619] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jul 12 13:46:26 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:46:27.000518 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f3aa8f21-dc90-4ee8-b0ea-b77be55a852e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:27.001075 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f3aa8f21-dc90-4ee8-b0ea-b77be55a852e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:27.007901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3aa8f21-dc90-4ee8-b0ea-b77be55a852e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:27.008344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3aa8f21-dc90-4ee8-b0ea-b77be55a852e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:27.009766 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3aa8f21-dc90-4ee8-b0ea-b77be55a852e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:27.010227 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3aa8f21-dc90-4ee8-b0ea-b77be55a852e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:27.136114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f3aa8f21-dc90-4ee8-b0ea-b77be55a852e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:27.143910 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f3aa8f21-dc90-4ee8-b0ea-b77be55a852e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.147345 Jul 12 13:46:27.144471 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 315/620] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:26 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:27.279949 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-58df64dc-57dd-442e-8e20-a17742778d46 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:27.280791 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-58df64dc-57dd-442e-8e20-a17742778d46 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:27.287569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-58df64dc-57dd-442e-8e20-a17742778d46 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:27.288108 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-58df64dc-57dd-442e-8e20-a17742778d46 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:27.288881 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-58df64dc-57dd-442e-8e20-a17742778d46 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:27.289323 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-58df64dc-57dd-442e-8e20-a17742778d46 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:27.319090 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-58df64dc-57dd-442e-8e20-a17742778d46 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043214 Jul 12 13:46:27.319648 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 306/621] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jul 12 13:46:27 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:46:28.160586 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f5e50f56-abf0-4e9e-9df6-471fe0eb0f97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:28.161203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f5e50f56-abf0-4e9e-9df6-471fe0eb0f97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:28.167680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5e50f56-abf0-4e9e-9df6-471fe0eb0f97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:28.168140 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5e50f56-abf0-4e9e-9df6-471fe0eb0f97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:28.168907 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5e50f56-abf0-4e9e-9df6-471fe0eb0f97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:28.169352 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f5e50f56-abf0-4e9e-9df6-471fe0eb0f97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:28.296047 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f5e50f56-abf0-4e9e-9df6-471fe0eb0f97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:28.304310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f5e50f56-abf0-4e9e-9df6-471fe0eb0f97 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.147670 Jul 12 13:46:28.304896 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 316/622] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:28 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:28.332610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-30ad1152-3c32-44b0-8967-20d35523f453 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:28.333905 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-30ad1152-3c32-44b0-8967-20d35523f453 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:28.342522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-30ad1152-3c32-44b0-8967-20d35523f453 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:28.343535 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-30ad1152-3c32-44b0-8967-20d35523f453 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:28.344909 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-30ad1152-3c32-44b0-8967-20d35523f453 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:28.345427 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-30ad1152-3c32-44b0-8967-20d35523f453 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:28.383261 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-30ad1152-3c32-44b0-8967-20d35523f453 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055974 Jul 12 13:46:28.389446 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 307/623] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jul 12 13:46:28 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:28.447682 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-43d27d63-d1d2-46b4-9d5e-11433c864662 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:28.448176 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-43d27d63-d1d2-46b4-9d5e-11433c864662 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:28.454176 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-43d27d63-d1d2-46b4-9d5e-11433c864662 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:28.454615 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-43d27d63-d1d2-46b4-9d5e-11433c864662 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:28.455374 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-43d27d63-d1d2-46b4-9d5e-11433c864662 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:28.455808 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-43d27d63-d1d2-46b4-9d5e-11433c864662 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:28.479860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-43d27d63-d1d2-46b4-9d5e-11433c864662 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:46:28.569715 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-43d27d63-d1d2-46b4-9d5e-11433c864662 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 204 len: 0 microversion: 2.20 time: 0.126213 Jul 12 13:46:28.570342 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 317/624] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Jul 12 13:46:28 2022] DELETE /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 12 13:46:28.579030 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6e040038-22e5-4c27-aed8-d3fa297438be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:28.579665 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6e040038-22e5-4c27-aed8-d3fa297438be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:28.585859 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6e040038-22e5-4c27-aed8-d3fa297438be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:28.586377 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6e040038-22e5-4c27-aed8-d3fa297438be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:28.587187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6e040038-22e5-4c27-aed8-d3fa297438be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:28.587622 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6e040038-22e5-4c27-aed8-d3fa297438be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:28.719909 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6e040038-22e5-4c27-aed8-d3fa297438be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:28.728277 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6e040038-22e5-4c27-aed8-d3fa297438be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:28.729797 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6e040038-22e5-4c27-aed8-d3fa297438be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:28.730984 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6e040038-22e5-4c27-aed8-d3fa297438be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.156292 Jul 12 13:46:28.731539 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 308/625] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:28 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:29.322909 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e94a4c18-3fe1-4e87-a488-2828519da22f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:29.323610 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e94a4c18-3fe1-4e87-a488-2828519da22f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:29.330173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e94a4c18-3fe1-4e87-a488-2828519da22f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:29.330632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e94a4c18-3fe1-4e87-a488-2828519da22f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:29.331398 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e94a4c18-3fe1-4e87-a488-2828519da22f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:29.331836 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e94a4c18-3fe1-4e87-a488-2828519da22f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:29.459143 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e94a4c18-3fe1-4e87-a488-2828519da22f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:29.467043 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e94a4c18-3fe1-4e87-a488-2828519da22f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.148385 Jul 12 13:46:29.467615 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 318/626] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:29 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:29.748646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-63b7050b-4b5b-45ae-879f-c92204c4c543 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:29.749247 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-63b7050b-4b5b-45ae-879f-c92204c4c543 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:29.756120 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-63b7050b-4b5b-45ae-879f-c92204c4c543 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:29.756575 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-63b7050b-4b5b-45ae-879f-c92204c4c543 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:29.757308 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-63b7050b-4b5b-45ae-879f-c92204c4c543 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:29.757738 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-63b7050b-4b5b-45ae-879f-c92204c4c543 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:29.884123 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-63b7050b-4b5b-45ae-879f-c92204c4c543 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:29.892109 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-63b7050b-4b5b-45ae-879f-c92204c4c543 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:29.893611 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-63b7050b-4b5b-45ae-879f-c92204c4c543 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:29.894777 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-63b7050b-4b5b-45ae-879f-c92204c4c543 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.150046 Jul 12 13:46:29.895327 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 309/627] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:29 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:30.484011 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a9013634-a81e-41ae-bcf4-9c077464fd89 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:30.484631 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a9013634-a81e-41ae-bcf4-9c077464fd89 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:30.491037 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9013634-a81e-41ae-bcf4-9c077464fd89 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:30.491479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9013634-a81e-41ae-bcf4-9c077464fd89 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:30.492251 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9013634-a81e-41ae-bcf4-9c077464fd89 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:30.492681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9013634-a81e-41ae-bcf4-9c077464fd89 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:30.627370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a9013634-a81e-41ae-bcf4-9c077464fd89 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:30.636050 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a9013634-a81e-41ae-bcf4-9c077464fd89 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.155832 Jul 12 13:46:30.636630 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 319/628] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:30 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:30.913158 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-00d97adb-462d-4082-b746-b12cc6adad3e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:30.913767 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-00d97adb-462d-4082-b746-b12cc6adad3e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:30.920894 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-00d97adb-462d-4082-b746-b12cc6adad3e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:30.921347 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-00d97adb-462d-4082-b746-b12cc6adad3e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:30.922143 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-00d97adb-462d-4082-b746-b12cc6adad3e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:30.922586 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-00d97adb-462d-4082-b746-b12cc6adad3e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:31.051375 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-00d97adb-462d-4082-b746-b12cc6adad3e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:31.059808 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-00d97adb-462d-4082-b746-b12cc6adad3e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:31.061322 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-00d97adb-462d-4082-b746-b12cc6adad3e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:31.062520 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-00d97adb-462d-4082-b746-b12cc6adad3e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.153242 Jul 12 13:46:31.063083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 310/629] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:30 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:31.653089 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-323a0249-8491-4ea7-8caa-45919ffcf802 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:31.653695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-323a0249-8491-4ea7-8caa-45919ffcf802 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:31.660328 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-323a0249-8491-4ea7-8caa-45919ffcf802 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:31.660781 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-323a0249-8491-4ea7-8caa-45919ffcf802 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:31.661539 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-323a0249-8491-4ea7-8caa-45919ffcf802 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:31.661993 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-323a0249-8491-4ea7-8caa-45919ffcf802 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:31.788927 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-323a0249-8491-4ea7-8caa-45919ffcf802 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:31.796837 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-323a0249-8491-4ea7-8caa-45919ffcf802 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.148183 Jul 12 13:46:31.797400 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 320/630] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:31 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:32.080390 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-06dfca92-1a1f-4916-a42d-95ce2b13cf65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:32.081092 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-06dfca92-1a1f-4916-a42d-95ce2b13cf65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:32.087956 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-06dfca92-1a1f-4916-a42d-95ce2b13cf65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:32.088399 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-06dfca92-1a1f-4916-a42d-95ce2b13cf65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:32.089151 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-06dfca92-1a1f-4916-a42d-95ce2b13cf65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:32.089582 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-06dfca92-1a1f-4916-a42d-95ce2b13cf65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:32.219504 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-06dfca92-1a1f-4916-a42d-95ce2b13cf65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:32.227392 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-06dfca92-1a1f-4916-a42d-95ce2b13cf65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:32.228912 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-06dfca92-1a1f-4916-a42d-95ce2b13cf65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:32.230088 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-06dfca92-1a1f-4916-a42d-95ce2b13cf65 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.153748 Jul 12 13:46:32.230661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 311/631] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:32 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:32.814889 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-11abeca5-4c6c-47fe-8285-7c5e8e673aa7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:32.815500 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-11abeca5-4c6c-47fe-8285-7c5e8e673aa7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:32.822134 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11abeca5-4c6c-47fe-8285-7c5e8e673aa7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:32.822613 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11abeca5-4c6c-47fe-8285-7c5e8e673aa7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:32.823370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11abeca5-4c6c-47fe-8285-7c5e8e673aa7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:32.823808 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-11abeca5-4c6c-47fe-8285-7c5e8e673aa7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:32.950905 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-11abeca5-4c6c-47fe-8285-7c5e8e673aa7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:32.959184 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-11abeca5-4c6c-47fe-8285-7c5e8e673aa7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.149053 Jul 12 13:46:32.959750 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 321/632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:32 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:33.247579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f67ebfe9-0338-438d-b108-0db972f78fa4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:33.248179 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f67ebfe9-0338-438d-b108-0db972f78fa4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:33.254912 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f67ebfe9-0338-438d-b108-0db972f78fa4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:33.255365 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f67ebfe9-0338-438d-b108-0db972f78fa4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:33.256120 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f67ebfe9-0338-438d-b108-0db972f78fa4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:33.256559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f67ebfe9-0338-438d-b108-0db972f78fa4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:33.388002 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f67ebfe9-0338-438d-b108-0db972f78fa4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:33.396026 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f67ebfe9-0338-438d-b108-0db972f78fa4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:33.397580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f67ebfe9-0338-438d-b108-0db972f78fa4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:33.398784 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f67ebfe9-0338-438d-b108-0db972f78fa4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.155125 Jul 12 13:46:33.399339 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 312/633] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:33 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:33.976535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-97cfca0d-a731-485c-875a-9cd4d4f47885 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:33.977149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-97cfca0d-a731-485c-875a-9cd4d4f47885 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:33.984153 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97cfca0d-a731-485c-875a-9cd4d4f47885 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:33.984608 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97cfca0d-a731-485c-875a-9cd4d4f47885 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:33.985376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97cfca0d-a731-485c-875a-9cd4d4f47885 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:33.985816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-97cfca0d-a731-485c-875a-9cd4d4f47885 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:34.116619 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-97cfca0d-a731-485c-875a-9cd4d4f47885 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:34.125125 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-97cfca0d-a731-485c-875a-9cd4d4f47885 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.152448 Jul 12 13:46:34.125686 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 322/634] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:33 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:34.417391 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4644fe59-3d9e-413a-bc4e-1599f313a145 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:34.418025 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4644fe59-3d9e-413a-bc4e-1599f313a145 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:34.424538 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4644fe59-3d9e-413a-bc4e-1599f313a145 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:34.424990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4644fe59-3d9e-413a-bc4e-1599f313a145 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:34.425749 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4644fe59-3d9e-413a-bc4e-1599f313a145 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:34.426213 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4644fe59-3d9e-413a-bc4e-1599f313a145 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:34.558544 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4644fe59-3d9e-413a-bc4e-1599f313a145 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:34.567214 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4644fe59-3d9e-413a-bc4e-1599f313a145 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:34.568720 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4644fe59-3d9e-413a-bc4e-1599f313a145 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:34.569866 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4644fe59-3d9e-413a-bc4e-1599f313a145 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.157180 Jul 12 13:46:34.570490 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 313/635] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:34 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:35.142454 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3d090228-4587-43a6-840e-c06ee0e5b4f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:35.143058 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3d090228-4587-43a6-840e-c06ee0e5b4f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:35.149541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3d090228-4587-43a6-840e-c06ee0e5b4f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:35.150014 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3d090228-4587-43a6-840e-c06ee0e5b4f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:35.151344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3d090228-4587-43a6-840e-c06ee0e5b4f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:35.151851 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3d090228-4587-43a6-840e-c06ee0e5b4f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:35.281949 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3d090228-4587-43a6-840e-c06ee0e5b4f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:35.290102 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3d090228-4587-43a6-840e-c06ee0e5b4f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1735 microversion: 2.1 time: 0.151229 Jul 12 13:46:35.290772 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 323/636] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:35 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:35.588983 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5ad16824-502a-4fe8-b7f5-4579fa8c4802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:35.589610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5ad16824-502a-4fe8-b7f5-4579fa8c4802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:35.596451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5ad16824-502a-4fe8-b7f5-4579fa8c4802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:35.596916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5ad16824-502a-4fe8-b7f5-4579fa8c4802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:35.597680 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5ad16824-502a-4fe8-b7f5-4579fa8c4802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:35.598144 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5ad16824-502a-4fe8-b7f5-4579fa8c4802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:35.729941 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5ad16824-502a-4fe8-b7f5-4579fa8c4802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:35.738172 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5ad16824-502a-4fe8-b7f5-4579fa8c4802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:35.739704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5ad16824-502a-4fe8-b7f5-4579fa8c4802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:35.740863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5ad16824-502a-4fe8-b7f5-4579fa8c4802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.156366 Jul 12 13:46:35.741422 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 314/637] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:35 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:36.307342 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a809a0d6-5880-4dff-851f-3c53359f172a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:36.307938 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a809a0d6-5880-4dff-851f-3c53359f172a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:36.314503 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a809a0d6-5880-4dff-851f-3c53359f172a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:36.314966 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a809a0d6-5880-4dff-851f-3c53359f172a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:36.315743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a809a0d6-5880-4dff-851f-3c53359f172a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:36.316160 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a809a0d6-5880-4dff-851f-3c53359f172a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:36.450245 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a809a0d6-5880-4dff-851f-3c53359f172a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:36.458086 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a809a0d6-5880-4dff-851f-3c53359f172a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1715 microversion: 2.1 time: 0.154590 Jul 12 13:46:36.458644 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 324/638] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:36 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:36.560802 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5d73beab-82a4-43c1-97c7-3e81763ab41a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:36.561297 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5d73beab-82a4-43c1-97c7-3e81763ab41a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:36.567288 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5d73beab-82a4-43c1-97c7-3e81763ab41a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:36.567735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5d73beab-82a4-43c1-97c7-3e81763ab41a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:36.568493 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5d73beab-82a4-43c1-97c7-3e81763ab41a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:36.568930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5d73beab-82a4-43c1-97c7-3e81763ab41a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:36.653252 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-5d73beab-82a4-43c1-97c7-3e81763ab41a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] HTTP exception thrown: Cannot 'detach_volume' instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee while it is in vm_state rescued Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5d73beab-82a4-43c1-97c7-3e81763ab41a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Request method failure captured: Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: DELETE /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments/1c220d30-796c-4644-a6d2-2bfdad0a7cdc HTTP/1.1 Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXorjIDAbtDtJtOvfy_yv9nBXh4UfqRhYUnfhCPKZ1w7W9kDGIwjj1ekTdMPn8zN7wGJMTx5Sr-aikVIUV7yloW36HiYAaoGvrQUKUEGS8UYjts_zznUym4pBD6f0O81kujlfPaGrVaLWq2QpCY88duImZRzAd5rjBlsG-Ag3b_ZjJI Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 026f214eb4ee4a9c807b928710c93db5 Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:46:36.654856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 026f214eb4ee4a9c807b928710c93db5 Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-ServerRescueNegativeTestJSON-544559158-project Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 4a6b3bd40ad744908a05df7410cace52 Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-ServerRescueNegativeTestJSON-544559158-project Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:46:36.656380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Cannot 'detach_volume' instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee while it is in vm_state rescued Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'server_id': 'f42ee030-0bf1-402b-b7f4-9c9a33ac5aee', 'id': '1c220d30-796c-4644-a6d2-2bfdad0a7cdc'} Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:46:36.658078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee while it is in vm_state rescued Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee while it is in vm_state rescued Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:46:36.659534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5d73beab-82a4-43c1-97c7-3e81763ab41a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Returning 409 to user: Cannot 'detach_volume' instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee while it is in vm_state rescued {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:46:36.660714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5d73beab-82a4-43c1-97c7-3e81763ab41a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments/1c220d30-796c-4644-a6d2-2bfdad0a7cdc" status: 409 len: 152 microversion: 2.1 time: 0.100003 Jul 12 13:46:36.660714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 315/639] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:46:36 2022] DELETE /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments/1c220d30-796c-4644-a6d2-2bfdad0a7cdc => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 13:46:36.665109 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-dfcf8bc7-71d5-4704-a08e-8c01cb75b3e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:36.665638 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-dfcf8bc7-71d5-4704-a08e-8c01cb75b3e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:36.672176 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dfcf8bc7-71d5-4704-a08e-8c01cb75b3e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:36.672620 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dfcf8bc7-71d5-4704-a08e-8c01cb75b3e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:36.673433 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dfcf8bc7-71d5-4704-a08e-8c01cb75b3e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:36.673868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dfcf8bc7-71d5-4704-a08e-8c01cb75b3e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:36.739870 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-dfcf8bc7-71d5-4704-a08e-8c01cb75b3e7 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "POST /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/action" status: 202 len: 0 microversion: 2.1 time: 0.078341 Jul 12 13:46:36.740488 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 325/640] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:46:36 2022] POST /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:46:36.748539 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-91392398-97b2-4f2a-a7d4-4d3045b318d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:36.749154 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-91392398-97b2-4f2a-a7d4-4d3045b318d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:36.756337 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-91392398-97b2-4f2a-a7d4-4d3045b318d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:36.756796 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-91392398-97b2-4f2a-a7d4-4d3045b318d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:36.757569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-91392398-97b2-4f2a-a7d4-4d3045b318d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:36.758038 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-91392398-97b2-4f2a-a7d4-4d3045b318d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:36.759573 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c93c12c6-7af8-4d3b-ab01-36d19a146dd9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:36.760850 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c93c12c6-7af8-4d3b-ab01-36d19a146dd9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:36.767558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c93c12c6-7af8-4d3b-ab01-36d19a146dd9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:36.768004 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c93c12c6-7af8-4d3b-ab01-36d19a146dd9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:36.768769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c93c12c6-7af8-4d3b-ab01-36d19a146dd9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:36.769200 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c93c12c6-7af8-4d3b-ab01-36d19a146dd9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:36.902485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-91392398-97b2-4f2a-a7d4-4d3045b318d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:36.908701 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=100 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:36.912206 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c93c12c6-7af8-4d3b-ab01-36d19a146dd9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:36.917446 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-91392398-97b2-4f2a-a7d4-4d3045b318d6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1723 microversion: 2.1 time: 0.172665 Jul 12 13:46:36.921148 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 316/641] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:36 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:36.924672 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c93c12c6-7af8-4d3b-ab01-36d19a146dd9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:36.926294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c93c12c6-7af8-4d3b-ab01-36d19a146dd9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:36.927454 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c93c12c6-7af8-4d3b-ab01-36d19a146dd9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1723 microversion: 2.20 time: 0.172111 Jul 12 13:46:36.939395 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 326/642] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:36 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:37.935127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-59b31a2e-63c7-4f0c-80e6-2ec87e53ef11 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:37.936412 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-59b31a2e-63c7-4f0c-80e6-2ec87e53ef11 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:37.944562 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-53cc3752-ef15-46d3-8965-7fce331815f5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:37.945019 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-59b31a2e-63c7-4f0c-80e6-2ec87e53ef11 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:37.945019 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-59b31a2e-63c7-4f0c-80e6-2ec87e53ef11 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:37.945208 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-53cc3752-ef15-46d3-8965-7fce331815f5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:37.945930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-59b31a2e-63c7-4f0c-80e6-2ec87e53ef11 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:37.946651 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-59b31a2e-63c7-4f0c-80e6-2ec87e53ef11 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:37.953990 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53cc3752-ef15-46d3-8965-7fce331815f5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:37.954442 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53cc3752-ef15-46d3-8965-7fce331815f5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:37.955219 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53cc3752-ef15-46d3-8965-7fce331815f5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:37.955659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-53cc3752-ef15-46d3-8965-7fce331815f5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:37.988985 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:38.059766 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-53cc3752-ef15-46d3-8965-7fce331815f5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:38.071949 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-53cc3752-ef15-46d3-8965-7fce331815f5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:38.075029 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-53cc3752-ef15-46d3-8965-7fce331815f5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:38.076469 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-53cc3752-ef15-46d3-8965-7fce331815f5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1655 microversion: 2.20 time: 0.135864 Jul 12 13:46:38.077515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 327/643] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:37 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1655 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:46:38.084502 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-0c17d6e9-b1f7-4064-8e3a-d4c453d2422f req-a6296e95-c494-4c5e-aeb6-3898abce85bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71d01af-d429-48d6-9f16-6255557bdb67", "name": "network-vif-deleted", "tag": "35051ab0-4751-427b-ae9e-ddc1611523c0"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:38.094484 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-0c17d6e9-b1f7-4064-8e3a-d4c453d2422f req-a6296e95-c494-4c5e-aeb6-3898abce85bf service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:38.095310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-0c17d6e9-b1f7-4064-8e3a-d4c453d2422f req-a6296e95-c494-4c5e-aeb6-3898abce85bf service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:38.115609 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-0c17d6e9-b1f7-4064-8e3a-d4c453d2422f req-a6296e95-c494-4c5e-aeb6-3898abce85bf service nova] Creating event network-vif-deleted:35051ab0-4751-427b-ae9e-ddc1611523c0 for instance e71d01af-d429-48d6-9f16-6255557bdb67 on hv-cinder-79797 Jul 12 13:46:38.123554 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-0c17d6e9-b1f7-4064-8e3a-d4c453d2422f req-a6296e95-c494-4c5e-aeb6-3898abce85bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044120 Jul 12 13:46:38.124600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 328/644] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:38.149869 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-59b31a2e-63c7-4f0c-80e6-2ec87e53ef11 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:38.160001 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-59b31a2e-63c7-4f0c-80e6-2ec87e53ef11 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1723 microversion: 2.1 time: 0.229119 Jul 12 13:46:38.160581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 317/645] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:37 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:39.096074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bd232820-cdc9-47ff-9ebf-f79feb8d7457 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:39.096750 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bd232820-cdc9-47ff-9ebf-f79feb8d7457 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:39.103029 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bd232820-cdc9-47ff-9ebf-f79feb8d7457 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:39.103547 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bd232820-cdc9-47ff-9ebf-f79feb8d7457 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:39.104304 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bd232820-cdc9-47ff-9ebf-f79feb8d7457 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:39.104738 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bd232820-cdc9-47ff-9ebf-f79feb8d7457 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:39.170168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bd232820-cdc9-47ff-9ebf-f79feb8d7457 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:39.178602 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bd232820-cdc9-47ff-9ebf-f79feb8d7457 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:39.179028 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-44e9300a-2db6-4943-8cd5-7f782ec2c03e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:39.179696 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-44e9300a-2db6-4943-8cd5-7f782ec2c03e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:39.180175 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bd232820-cdc9-47ff-9ebf-f79feb8d7457 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:39.181326 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bd232820-cdc9-47ff-9ebf-f79feb8d7457 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1655 microversion: 2.20 time: 0.090116 Jul 12 13:46:39.182125 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 329/646] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:39 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1655 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:39.186320 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-44e9300a-2db6-4943-8cd5-7f782ec2c03e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:39.186773 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-44e9300a-2db6-4943-8cd5-7f782ec2c03e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:39.187541 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-44e9300a-2db6-4943-8cd5-7f782ec2c03e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:39.187975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-44e9300a-2db6-4943-8cd5-7f782ec2c03e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:39.324770 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-44e9300a-2db6-4943-8cd5-7f782ec2c03e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:39.332829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-44e9300a-2db6-4943-8cd5-7f782ec2c03e tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1723 microversion: 2.1 time: 0.157610 Jul 12 13:46:39.333391 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 318/647] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:39 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:40.199152 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:40.199749 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:40.206181 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:40.206738 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:40.207519 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:40.207949 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:40.240399 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:40.240849 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:40.241304 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lazy-loading 'fault' on Instance uuid e71d01af-d429-48d6-9f16-6255557bdb67 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:46:40.289936 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:40.299098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:40.300630 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:40.302107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aa579116-402f-4fae-bba6-3934a4b57eeb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 200 len: 1371 microversion: 2.20 time: 0.106790 Jul 12 13:46:40.302657 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 330/648] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:40 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:40.306604 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-41ce9f39-c59c-45f2-a67a-f14c3f856f28 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:40.307093 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-41ce9f39-c59c-45f2-a67a-f14c3f856f28 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:40.309376 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:40.314785 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-41ce9f39-c59c-45f2-a67a-f14c3f856f28 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:40.315257 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-41ce9f39-c59c-45f2-a67a-f14c3f856f28 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:40.316014 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-41ce9f39-c59c-45f2-a67a-f14c3f856f28 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:40.316452 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-41ce9f39-c59c-45f2-a67a-f14c3f856f28 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:40.350728 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0bd52db4-6cec-4655-8fac-867caca10d9a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:40.351368 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0bd52db4-6cec-4655-8fac-867caca10d9a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:40.359206 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bd52db4-6cec-4655-8fac-867caca10d9a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:40.359727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bd52db4-6cec-4655-8fac-867caca10d9a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:40.360501 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bd52db4-6cec-4655-8fac-867caca10d9a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:40.360943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0bd52db4-6cec-4655-8fac-867caca10d9a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:40.402704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-41ce9f39-c59c-45f2-a67a-f14c3f856f28 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lazy-loading 'services' on Instance uuid a5b06025-d3af-43af-bd55-4d3658abe9bf {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:46:40.474873 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-41ce9f39-c59c-45f2-a67a-f14c3f856f28 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf/os-volume_attachments/0f010691-92cc-44e2-8570-4a212e38ee47" status: 202 len: 0 microversion: 2.1 time: 0.172115 Jul 12 13:46:40.475464 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 319/649] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:46:40 2022] DELETE /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf/os-volume_attachments/0f010691-92cc-44e2-8570-4a212e38ee47 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:46:40.495897 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0bd52db4-6cec-4655-8fac-867caca10d9a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:40.504329 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0bd52db4-6cec-4655-8fac-867caca10d9a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1729 microversion: 2.1 time: 0.157496 Jul 12 13:46:40.505256 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 331/650] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:40 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:40.521660 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-be70f452-7a82-4751-b1c5-8bfb20b80f30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:40.522455 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-be70f452-7a82-4751-b1c5-8bfb20b80f30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:40.532732 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be70f452-7a82-4751-b1c5-8bfb20b80f30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:40.533214 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be70f452-7a82-4751-b1c5-8bfb20b80f30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:40.534011 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be70f452-7a82-4751-b1c5-8bfb20b80f30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:40.534483 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-be70f452-7a82-4751-b1c5-8bfb20b80f30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:40.615968 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-be70f452-7a82-4751-b1c5-8bfb20b80f30 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098446 Jul 12 13:46:40.616560 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 320/651] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jul 12 13:46:40 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:46:41.321201 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1042fc8d-914b-4935-a101-e880f73e6be8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:41.321930 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1042fc8d-914b-4935-a101-e880f73e6be8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:41.328816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1042fc8d-914b-4935-a101-e880f73e6be8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:41.329273 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1042fc8d-914b-4935-a101-e880f73e6be8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:41.330084 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1042fc8d-914b-4935-a101-e880f73e6be8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:41.330529 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1042fc8d-914b-4935-a101-e880f73e6be8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:41.344700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-1042fc8d-914b-4935-a101-e880f73e6be8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] HTTP exception thrown: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1042fc8d-914b-4935-a101-e880f73e6be8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Request method failure captured: Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 HTTP/1.1 Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo5YVbWKE0s-CXcm9k_7ZnOCz7_dPpZtaxsOXYXpNOMgGT1EIjLMzAANA4iu5se2nfAgfcPwwXX92xdY_VpfTApW7n3V6fTPMqcjtZwJqsbpVT_UW2iAUu5ku7wYeZzvJEDI7gNQaC8HarW3k4CNDl7i-M1KLCjJm3frCP-57ek1w4 Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:46:41.346394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: d9e5bc258de54fd6b3811401783a7408 Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:46:41.347818 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'e71d01af-d429-48d6-9f16-6255557bdb67'} Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:46:41.348600 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:46:41.349871 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:46:41.354316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1042fc8d-914b-4935-a101-e880f73e6be8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Returning 404 to user: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:46:41.354316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1042fc8d-914b-4935-a101-e880f73e6be8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 404 len: 111 microversion: 2.20 time: 0.030981 Jul 12 13:46:41.354316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 332/652] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:41 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:46:41.358215 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-da3fcaf9-5d73-448e-9a36-16b9e603dc49 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '.version_select at 0x7f3a15b67ee0>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:41.377043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-da3fcaf9-5d73-448e-9a36-16b9e603dc49 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-110721601" status: 204 len: 0 microversion: 2.20 time: 0.022214 Jul 12 13:46:41.379084 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 321/653] 10.222.0.52 () {60 vars in 1258 bytes} [Tue Jul 12 13:46:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-110721601 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 13:46:41.800904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-fb89e168-4816-477b-ae71-7c095c193b8f req-76884d20-b618-4e96-9f8d-f1ce0ec6dbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42ee030-0bf1-402b-b7f4-9c9a33ac5aee", "tag": "24703b74-9dc6-4b80-a6ab-4c0de6ab1334"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:41.810277 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-fb89e168-4816-477b-ae71-7c095c193b8f req-76884d20-b618-4e96-9f8d-f1ce0ec6dbf0 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:41.810943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-fb89e168-4816-477b-ae71-7c095c193b8f req-76884d20-b618-4e96-9f8d-f1ce0ec6dbf0 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:41.828980 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-fb89e168-4816-477b-ae71-7c095c193b8f req-76884d20-b618-4e96-9f8d-f1ce0ec6dbf0 service nova] Creating event network-changed:24703b74-9dc6-4b80-a6ab-4c0de6ab1334 for instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee on hv-cinder-79797 Jul 12 13:46:41.834658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-fb89e168-4816-477b-ae71-7c095c193b8f req-76884d20-b618-4e96-9f8d-f1ce0ec6dbf0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038100 Jul 12 13:46:41.835268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 333/654] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:42.110378 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d688a255-acae-48ce-80c9-124da4bfbe40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Action: 'create', calling method: .version_select at 0x7f3a15c8ea60>, body: {"keypair": {"name": "tempest-keypair-447679651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNeaGj3KrCU9bGro8b+uAgbRdWwKvCk2XuniohE+lkvyAX04cXHI+kF0h9m7dXKu0HbOMwsEY7N5oJ6r9fMwwMXgIlvPa7JlVTw8BUyS0aaz1FzWVWtOMMIme8YgHzu5Q=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:42.140123 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-d688a255-acae-48ce-80c9-124da4bfbe40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Getting quotas for project e54281ff11484f77b0d20fd039ef938e. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:46:42.147492 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-d688a255-acae-48ce-80c9-124da4bfbe40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Getting quotas for user d9e5bc258de54fd6b3811401783a7408 and project e54281ff11484f77b0d20fd039ef938e. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:46:42.184282 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d688a255-acae-48ce-80c9-124da4bfbe40 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.081986 Jul 12 13:46:42.185474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 322/655] 10.222.0.52 () {62 vars in 1199 bytes} [Tue Jul 12 13:46:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 12 13:46:42.667445 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e9045e34-93cc-45e8-8697-b9b785bdc480 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:42.669385 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e9045e34-93cc-45e8-8697-b9b785bdc480 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:42.677705 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9045e34-93cc-45e8-8697-b9b785bdc480 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:42.679065 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9045e34-93cc-45e8-8697-b9b785bdc480 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:42.680393 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9045e34-93cc-45e8-8697-b9b785bdc480 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:42.681037 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e9045e34-93cc-45e8-8697-b9b785bdc480 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:42.723148 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e9045e34-93cc-45e8-8697-b9b785bdc480 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:46:42.810831 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e9045e34-93cc-45e8-8697-b9b785bdc480 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 204 len: 0 microversion: 2.1 time: 0.148236 Jul 12 13:46:42.811704 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 334/656] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:46:42 2022] DELETE /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:46:42.822814 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1a4a8aed-3281-480c-8dfe-3b8be2d8e7b6 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:42.823510 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1a4a8aed-3281-480c-8dfe-3b8be2d8e7b6 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:42.830078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a4a8aed-3281-480c-8dfe-3b8be2d8e7b6 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:42.830344 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a4a8aed-3281-480c-8dfe-3b8be2d8e7b6 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:42.834919 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a4a8aed-3281-480c-8dfe-3b8be2d8e7b6 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:42.834919 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a4a8aed-3281-480c-8dfe-3b8be2d8e7b6 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:43.038423 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1a4a8aed-3281-480c-8dfe-3b8be2d8e7b6 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:43.046501 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1a4a8aed-3281-480c-8dfe-3b8be2d8e7b6 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1514 microversion: 2.1 time: 0.230070 Jul 12 13:46:43.047073 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 323/657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:42 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:43.689200 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-555831798", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b185d3e3-0515-4a5f-a4e6-7250d0186851"}], "security_groups": [{"name": "tempest-securitygroup--436538731"}], "key_name": "tempest-keypair-447679651", "user_data": "}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:43.792865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] validate_networks() for [('b185d3e3-0515-4a5f-a4e6-7250d0186851', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:46:43.850421 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-76d619d8-ee03-46a1-a7da-b233e5a435b7 req-0b3cb867-3ec8-4231-8a01-34bc941df9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42ee030-0bf1-402b-b7f4-9c9a33ac5aee", "tag": "24703b74-9dc6-4b80-a6ab-4c0de6ab1334"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:43.859818 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-76d619d8-ee03-46a1-a7da-b233e5a435b7 req-0b3cb867-3ec8-4231-8a01-34bc941df9aa service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:43.860266 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-76d619d8-ee03-46a1-a7da-b233e5a435b7 req-0b3cb867-3ec8-4231-8a01-34bc941df9aa service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:43.873132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-76d619d8-ee03-46a1-a7da-b233e5a435b7 req-0b3cb867-3ec8-4231-8a01-34bc941df9aa service nova] Creating event network-changed:24703b74-9dc6-4b80-a6ab-4c0de6ab1334 for instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee on hv-cinder-79797 Jul 12 13:46:43.878896 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-76d619d8-ee03-46a1-a7da-b233e5a435b7 req-0b3cb867-3ec8-4231-8a01-34bc941df9aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032098 Jul 12 13:46:43.879506 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 324/658] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:46:44.064542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b6db46e7-b347-445b-b474-19e214344c98 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:44.065163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b6db46e7-b347-445b-b474-19e214344c98 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:44.075658 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6db46e7-b347-445b-b474-19e214344c98 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:44.076104 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6db46e7-b347-445b-b474-19e214344c98 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:44.077024 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6db46e7-b347-445b-b474-19e214344c98 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:44.077788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6db46e7-b347-445b-b474-19e214344c98 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:44.169549 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:46:44.169999 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:46:44.170482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:46:44.170891 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:46:44.171310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:46:44.180012 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:44.180462 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:44.181744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:44.182240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:44.199612 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Getting quotas for project e54281ff11484f77b0d20fd039ef938e. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:46:44.203484 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Getting quotas for user d9e5bc258de54fd6b3811401783a7408 and project e54281ff11484f77b0d20fd039ef938e. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:46:44.210515 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b6db46e7-b347-445b-b474-19e214344c98 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:44.214666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:46:44.217312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:46:44.217939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b6db46e7-b347-445b-b474-19e214344c98 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1514 microversion: 2.1 time: 0.157771 Jul 12 13:46:44.218522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 325/659] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:44 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:44.263783 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4c8d319c-e094-4f1c-9800-936be6a94ba4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.579293 Jul 12 13:46:44.264447 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 335/660] 10.222.0.52 () {62 vars in 1187 bytes} [Tue Jul 12 13:46:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 13:46:44.274296 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5fa3a7ea-b4eb-475f-abcd-1e2d8b089c0d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:44.274907 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5fa3a7ea-b4eb-475f-abcd-1e2d8b089c0d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:44.328452 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5fa3a7ea-b4eb-475f-abcd-1e2d8b089c0d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:44.336160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5fa3a7ea-b4eb-475f-abcd-1e2d8b089c0d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:44.338521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5fa3a7ea-b4eb-475f-abcd-1e2d8b089c0d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:44.339683 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5fa3a7ea-b4eb-475f-abcd-1e2d8b089c0d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1280 microversion: 2.20 time: 0.069355 Jul 12 13:46:44.340262 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 326/661] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:44 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:46:45.236289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-891d3489-c2d3-487e-b43a-3cde58fbb0a4 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:45.236900 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-891d3489-c2d3-487e-b43a-3cde58fbb0a4 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:45.244659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-891d3489-c2d3-487e-b43a-3cde58fbb0a4 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:45.245405 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-891d3489-c2d3-487e-b43a-3cde58fbb0a4 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:45.246397 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-891d3489-c2d3-487e-b43a-3cde58fbb0a4 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:45.246836 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-891d3489-c2d3-487e-b43a-3cde58fbb0a4 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:45.357608 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-02c0babf-a3e3-4e2e-b79a-ec3ff230f254 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:45.358250 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-02c0babf-a3e3-4e2e-b79a-ec3ff230f254 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:45.365260 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02c0babf-a3e3-4e2e-b79a-ec3ff230f254 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:45.365719 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02c0babf-a3e3-4e2e-b79a-ec3ff230f254 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:45.366522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02c0babf-a3e3-4e2e-b79a-ec3ff230f254 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:45.366964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02c0babf-a3e3-4e2e-b79a-ec3ff230f254 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:45.430197 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-02c0babf-a3e3-4e2e-b79a-ec3ff230f254 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:45.439381 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-02c0babf-a3e3-4e2e-b79a-ec3ff230f254 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:45.440908 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-02c0babf-a3e3-4e2e-b79a-ec3ff230f254 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:45.442223 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-02c0babf-a3e3-4e2e-b79a-ec3ff230f254 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1332 microversion: 2.20 time: 0.088333 Jul 12 13:46:45.442776 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 327/662] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:45 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:46:45.472706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-891d3489-c2d3-487e-b43a-3cde58fbb0a4 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:45.483036 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-891d3489-c2d3-487e-b43a-3cde58fbb0a4 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 200 len: 1514 microversion: 2.1 time: 0.251001 Jul 12 13:46:45.483926 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 336/663] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:45 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:45.845065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-0e8074bc-c970-49d2-82bd-8b759d472bef req-3fbec5ab-7a4a-4405-870b-b2986db74dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b06025-d3af-43af-bd55-4d3658abe9bf", "name": "network-vif-deleted", "tag": "89229d89-b64d-4a5f-b89f-c94fa25832e9"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:45.854139 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-0e8074bc-c970-49d2-82bd-8b759d472bef req-3fbec5ab-7a4a-4405-870b-b2986db74dc3 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:45.854672 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-0e8074bc-c970-49d2-82bd-8b759d472bef req-3fbec5ab-7a4a-4405-870b-b2986db74dc3 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:45.865815 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-0e8074bc-c970-49d2-82bd-8b759d472bef req-3fbec5ab-7a4a-4405-870b-b2986db74dc3 service nova] Creating event network-vif-deleted:89229d89-b64d-4a5f-b89f-c94fa25832e9 for instance a5b06025-d3af-43af-bd55-4d3658abe9bf on hv-cinder-79797 Jul 12 13:46:45.871152 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-0e8074bc-c970-49d2-82bd-8b759d472bef req-3fbec5ab-7a4a-4405-870b-b2986db74dc3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029794 Jul 12 13:46:45.871743 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 328/664] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:46.462746 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3a57a4dd-292f-4e40-820e-20ea2a5c94db tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:46.463598 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3a57a4dd-292f-4e40-820e-20ea2a5c94db tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:46.466890 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:46.476031 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a57a4dd-292f-4e40-820e-20ea2a5c94db tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:46.477532 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a57a4dd-292f-4e40-820e-20ea2a5c94db tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:46.478839 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a57a4dd-292f-4e40-820e-20ea2a5c94db tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:46.479375 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3a57a4dd-292f-4e40-820e-20ea2a5c94db tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:46.503580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-69b702cf-bb05-42b7-b1bf-07da3238ca91 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:46.504337 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-69b702cf-bb05-42b7-b1bf-07da3238ca91 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: a5b06025-d3af-43af-bd55-4d3658abe9bf] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:46.516699 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-69b702cf-bb05-42b7-b1bf-07da3238ca91 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:46.517549 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-69b702cf-bb05-42b7-b1bf-07da3238ca91 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:46.518408 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-69b702cf-bb05-42b7-b1bf-07da3238ca91 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:46.519236 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-69b702cf-bb05-42b7-b1bf-07da3238ca91 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:46.534210 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-69b702cf-bb05-42b7-b1bf-07da3238ca91 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] HTTP exception thrown: Instance a5b06025-d3af-43af-bd55-4d3658abe9bf could not be found. Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-69b702cf-bb05-42b7-b1bf-07da3238ca91 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Request method failure captured: Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf HTTP/1.1 Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXsIl0w3ke-KkBCSH0UZknNydPnb7swXI7-TAyy1zxp0HTZu8Cz0HOsdCr1f4jIzQOvecLe4c1dTWr5oach7svqibWE8O3TAdZfoy9RHPOe2FUwERW4YAE-IbDXxCPG0N0a6UJikmzKac722sUKaE_a3j6EDobyFmkPdMgfvEiTLITc Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: adf5aa6b70414b8f81904a32fa4fa1ab Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-VolumesSnapshotTestJSON-843177554 Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:46:46.535916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/adf5aa6b70414b8f81904a32fa4fa1ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/adf5aa6b70414b8f81904a32fa4fa1ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/adf5aa6b70414b8f81904a32fa4fa1ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_adf5aa6b70414b8f81904a32fa4fa1ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-VolumesSnapshotTestJSON-843177554 Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: adf5aa6b70414b8f81904a32fa4fa1ab Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-843177554 Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-VolumesSnapshotTestJSON-843177554-project Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 1a50af3c7d004e78a99875e1f36a9508 Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-VolumesSnapshotTestJSON-843177554-project Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance a5b06025-d3af-43af-bd55-4d3658abe9bf could not be found. Jul 12 13:46:46.537439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'a5b06025-d3af-43af-bd55-4d3658abe9bf'} Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b06025-d3af-43af-bd55-4d3658abe9bf could not be found. Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:46:46.538475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b06025-d3af-43af-bd55-4d3658abe9bf could not be found. Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b06025-d3af-43af-bd55-4d3658abe9bf could not be found. Jul 12 13:46:46.540208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:46:46.542148 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-69b702cf-bb05-42b7-b1bf-07da3238ca91 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Returning 404 to user: Instance a5b06025-d3af-43af-bd55-4d3658abe9bf could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:46:46.542148 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-69b702cf-bb05-42b7-b1bf-07da3238ca91 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf" status: 404 len: 111 microversion: 2.1 time: 0.039786 Jul 12 13:46:46.542148 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 329/665] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:46 2022] GET /compute/v2.1/servers/a5b06025-d3af-43af-bd55-4d3658abe9bf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:46:46.554265 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3a57a4dd-292f-4e40-820e-20ea2a5c94db tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:46.562895 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3a57a4dd-292f-4e40-820e-20ea2a5c94db tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:46.564622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3a57a4dd-292f-4e40-820e-20ea2a5c94db tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:46.566372 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3a57a4dd-292f-4e40-820e-20ea2a5c94db tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1338 microversion: 2.20 time: 0.108763 Jul 12 13:46:46.566946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 337/666] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:46 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:47.585388 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b9d03350-9595-4bd2-9ec1-16708c118a43 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:47.586027 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b9d03350-9595-4bd2-9ec1-16708c118a43 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:47.593215 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b9d03350-9595-4bd2-9ec1-16708c118a43 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:47.593671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b9d03350-9595-4bd2-9ec1-16708c118a43 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:47.594563 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b9d03350-9595-4bd2-9ec1-16708c118a43 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:47.595052 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b9d03350-9595-4bd2-9ec1-16708c118a43 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:47.727334 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b9d03350-9595-4bd2-9ec1-16708c118a43 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:47.735273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b9d03350-9595-4bd2-9ec1-16708c118a43 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:47.736837 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b9d03350-9595-4bd2-9ec1-16708c118a43 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:47.737997 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b9d03350-9595-4bd2-9ec1-16708c118a43 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1405 microversion: 2.20 time: 0.156494 Jul 12 13:46:47.738570 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 330/667] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:47 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:47.888791 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-fa5716b2-efb4-48d9-8698-0ee5360c1c84 req-02a6feb0-82f6-4021-a51e-3ff1b1245903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ae49d6-301e-4cf8-9037-3b59098c81c9", "tag": "f5b2cadb-da8b-47ae-8893-71246ab085ad"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:47.901013 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-fa5716b2-efb4-48d9-8698-0ee5360c1c84 req-02a6feb0-82f6-4021-a51e-3ff1b1245903 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:47.901479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-fa5716b2-efb4-48d9-8698-0ee5360c1c84 req-02a6feb0-82f6-4021-a51e-3ff1b1245903 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:47.912892 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-fa5716b2-efb4-48d9-8698-0ee5360c1c84 req-02a6feb0-82f6-4021-a51e-3ff1b1245903 service nova] Creating event network-changed:f5b2cadb-da8b-47ae-8893-71246ab085ad for instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 on hv-cinder-79797 Jul 12 13:46:47.920009 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-fa5716b2-efb4-48d9-8698-0ee5360c1c84 req-02a6feb0-82f6-4021-a51e-3ff1b1245903 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036564 Jul 12 13:46:47.920009 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 338/668] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:48.755771 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-430eb29a-f22a-4fc9-8bf0-44108cfeb91b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:48.756387 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-430eb29a-f22a-4fc9-8bf0-44108cfeb91b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:48.763732 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-430eb29a-f22a-4fc9-8bf0-44108cfeb91b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:48.764187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-430eb29a-f22a-4fc9-8bf0-44108cfeb91b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:48.764996 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-430eb29a-f22a-4fc9-8bf0-44108cfeb91b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:48.765441 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-430eb29a-f22a-4fc9-8bf0-44108cfeb91b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:48.898264 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-430eb29a-f22a-4fc9-8bf0-44108cfeb91b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:48.906331 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-430eb29a-f22a-4fc9-8bf0-44108cfeb91b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:48.907865 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-430eb29a-f22a-4fc9-8bf0-44108cfeb91b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:48.908983 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-430eb29a-f22a-4fc9-8bf0-44108cfeb91b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1405 microversion: 2.20 time: 0.157404 Jul 12 13:46:48.909540 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 331/669] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:48 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:49.928303 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cbb1bc8e-9684-45ac-8901-54292e6e0df2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:49.929017 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cbb1bc8e-9684-45ac-8901-54292e6e0df2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:49.936680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbb1bc8e-9684-45ac-8901-54292e6e0df2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:49.937249 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbb1bc8e-9684-45ac-8901-54292e6e0df2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:49.938223 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbb1bc8e-9684-45ac-8901-54292e6e0df2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:49.938739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbb1bc8e-9684-45ac-8901-54292e6e0df2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:50.132617 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cbb1bc8e-9684-45ac-8901-54292e6e0df2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:50.142211 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cbb1bc8e-9684-45ac-8901-54292e6e0df2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:50.143731 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cbb1bc8e-9684-45ac-8901-54292e6e0df2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:50.144867 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cbb1bc8e-9684-45ac-8901-54292e6e0df2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1405 microversion: 2.20 time: 0.221544 Jul 12 13:46:50.145440 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 339/670] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:49 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:51.163571 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-413cb314-7b2c-4494-9e9c-fcfc7eb0964c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:51.164181 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-413cb314-7b2c-4494-9e9c-fcfc7eb0964c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:51.171746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-413cb314-7b2c-4494-9e9c-fcfc7eb0964c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:51.172200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-413cb314-7b2c-4494-9e9c-fcfc7eb0964c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:51.173173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-413cb314-7b2c-4494-9e9c-fcfc7eb0964c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:51.173622 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-413cb314-7b2c-4494-9e9c-fcfc7eb0964c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:51.336730 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-413cb314-7b2c-4494-9e9c-fcfc7eb0964c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:51.345494 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-413cb314-7b2c-4494-9e9c-fcfc7eb0964c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:51.347055 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-413cb314-7b2c-4494-9e9c-fcfc7eb0964c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:51.348178 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-413cb314-7b2c-4494-9e9c-fcfc7eb0964c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1405 microversion: 2.20 time: 0.189321 Jul 12 13:46:51.348878 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 332/671] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:51 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:52.366465 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-91fab6c0-3bea-4e7a-bbf1-8e730c3611f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:52.367064 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-91fab6c0-3bea-4e7a-bbf1-8e730c3611f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:52.373692 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91fab6c0-3bea-4e7a-bbf1-8e730c3611f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:52.374168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91fab6c0-3bea-4e7a-bbf1-8e730c3611f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:52.374928 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91fab6c0-3bea-4e7a-bbf1-8e730c3611f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:52.375423 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-91fab6c0-3bea-4e7a-bbf1-8e730c3611f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:52.613702 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-91fab6c0-3bea-4e7a-bbf1-8e730c3611f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:52.621927 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-91fab6c0-3bea-4e7a-bbf1-8e730c3611f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:52.623456 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-91fab6c0-3bea-4e7a-bbf1-8e730c3611f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:52.624564 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-91fab6c0-3bea-4e7a-bbf1-8e730c3611f4 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1405 microversion: 2.20 time: 0.262052 Jul 12 13:46:52.625128 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 340/672] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:52 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1405 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:53.643087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-cee48560-a790-4abc-8d58-8a271097a05f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:53.643728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-cee48560-a790-4abc-8d58-8a271097a05f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:53.651065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cee48560-a790-4abc-8d58-8a271097a05f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:53.651517 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cee48560-a790-4abc-8d58-8a271097a05f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:53.652283 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cee48560-a790-4abc-8d58-8a271097a05f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:53.652726 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cee48560-a790-4abc-8d58-8a271097a05f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:53.846965 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-cee48560-a790-4abc-8d58-8a271097a05f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:53.855303 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-cee48560-a790-4abc-8d58-8a271097a05f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:53.856819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-cee48560-a790-4abc-8d58-8a271097a05f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:53.857923 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-cee48560-a790-4abc-8d58-8a271097a05f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1405 microversion: 2.20 time: 0.218830 Jul 12 13:46:53.858504 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 333/673] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:53 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:54.388415 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-388949532", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "networks": [{"uuid": "5e1de4e4-e8bd-4ed5-8403-4e8d8515d177"}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:54.395675 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:54.396342 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:54.442739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] validate_networks() for [('5e1de4e4-e8bd-4ed5-8403-4e8d8515d177', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:46:54.784699 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:46:54.785116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:46:54.785601 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:46:54.786012 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:46:54.786422 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:46:54.795137 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:54.795598 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:54.796382 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:54.796815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:54.814108 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Getting quotas for project adf5aa6b70414b8f81904a32fa4fa1ab. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:46:54.817984 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Getting quotas for user 1a50af3c7d004e78a99875e1f36a9508 and project adf5aa6b70414b8f81904a32fa4fa1ab. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:46:54.829200 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:46:54.831418 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:46:54.875662 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a9fb0b8f-dfb0-4b3e-b491-b195a4d0d5fc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:54.876200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a9fb0b8f-dfb0-4b3e-b491-b195a4d0d5fc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:54.877573 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-71d1423e-5da9-4690-b2e7-acdb11799f9b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492352 Jul 12 13:46:54.878387 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 341/674] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:46:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:46:54.878519 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=6 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:54.883926 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a9fb0b8f-dfb0-4b3e-b491-b195a4d0d5fc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:54.884862 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a9fb0b8f-dfb0-4b3e-b491-b195a4d0d5fc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:54.885830 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a9fb0b8f-dfb0-4b3e-b491-b195a4d0d5fc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:54.886466 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a9fb0b8f-dfb0-4b3e-b491-b195a4d0d5fc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:54.888465 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a2c0eaa8-1021-4da3-98f0-4dd2c3627574 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:54.889362 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a2c0eaa8-1021-4da3-98f0-4dd2c3627574 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:54.948835 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a2c0eaa8-1021-4da3-98f0-4dd2c3627574 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:54.957478 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a2c0eaa8-1021-4da3-98f0-4dd2c3627574 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1218 microversion: 2.1 time: 0.072435 Jul 12 13:46:54.958299 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 342/675] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:54 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:55.031053 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a9fb0b8f-dfb0-4b3e-b491-b195a4d0d5fc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:55.039241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a9fb0b8f-dfb0-4b3e-b491-b195a4d0d5fc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:55.041294 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a9fb0b8f-dfb0-4b3e-b491-b195a4d0d5fc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:55.042444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a9fb0b8f-dfb0-4b3e-b491-b195a4d0d5fc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1405 microversion: 2.20 time: 0.170912 Jul 12 13:46:55.043010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 334/676] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:54 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:46:55.439007 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-e76a1a02-0189-44c6-8fbf-570051385682 req-ce24757c-9bff-47c1-9d5e-8d0a0ce84fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ae49d6-301e-4cf8-9037-3b59098c81c9", "name": "network-vif-plugged", "status": "completed", "tag": "f5b2cadb-da8b-47ae-8893-71246ab085ad"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:55.449830 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-e76a1a02-0189-44c6-8fbf-570051385682 req-ce24757c-9bff-47c1-9d5e-8d0a0ce84fe7 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:55.450335 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-e76a1a02-0189-44c6-8fbf-570051385682 req-ce24757c-9bff-47c1-9d5e-8d0a0ce84fe7 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:55.466542 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-e76a1a02-0189-44c6-8fbf-570051385682 req-ce24757c-9bff-47c1-9d5e-8d0a0ce84fe7 service nova] Creating event network-vif-plugged:f5b2cadb-da8b-47ae-8893-71246ab085ad for instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 on hv-cinder-79797 Jul 12 13:46:55.473763 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-e76a1a02-0189-44c6-8fbf-570051385682 req-ce24757c-9bff-47c1-9d5e-8d0a0ce84fe7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039207 Jul 12 13:46:55.474510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 343/677] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:46:55.975204 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-9755c194-388d-4ab1-8e86-48ebfa36db44 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:55.975822 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-9755c194-388d-4ab1-8e86-48ebfa36db44 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:55.982739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9755c194-388d-4ab1-8e86-48ebfa36db44 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:55.983175 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9755c194-388d-4ab1-8e86-48ebfa36db44 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:55.983958 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9755c194-388d-4ab1-8e86-48ebfa36db44 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:55.984403 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9755c194-388d-4ab1-8e86-48ebfa36db44 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:56.050296 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-9755c194-388d-4ab1-8e86-48ebfa36db44 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:56.058565 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-9755c194-388d-4ab1-8e86-48ebfa36db44 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1288 microversion: 2.1 time: 0.087172 Jul 12 13:46:56.059140 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 335/678] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:55 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:56.060950 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-eabf829e-1761-40c8-b80e-eec3c77a67ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:56.061700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-eabf829e-1761-40c8-b80e-eec3c77a67ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:56.068131 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eabf829e-1761-40c8-b80e-eec3c77a67ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:56.068577 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eabf829e-1761-40c8-b80e-eec3c77a67ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:56.069345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eabf829e-1761-40c8-b80e-eec3c77a67ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:56.069775 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-eabf829e-1761-40c8-b80e-eec3c77a67ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:56.202870 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-eabf829e-1761-40c8-b80e-eec3c77a67ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:56.210743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-eabf829e-1761-40c8-b80e-eec3c77a67ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:56.212281 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-eabf829e-1761-40c8-b80e-eec3c77a67ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:56.213343 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-eabf829e-1761-40c8-b80e-eec3c77a67ea tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1405 microversion: 2.20 time: 0.157339 Jul 12 13:46:56.213899 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 344/679] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:56 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:46:57.076273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-29fe14ad-97c7-4c10-a835-82bff2c677f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:57.076900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-29fe14ad-97c7-4c10-a835-82bff2c677f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:57.083309 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-29fe14ad-97c7-4c10-a835-82bff2c677f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.083749 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-29fe14ad-97c7-4c10-a835-82bff2c677f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.084505 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-29fe14ad-97c7-4c10-a835-82bff2c677f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.084933 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-29fe14ad-97c7-4c10-a835-82bff2c677f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.218146 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-29fe14ad-97c7-4c10-a835-82bff2c677f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:57.231433 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2fdc52b0-e01e-4913-aa50-da107c24830e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:57.232666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2fdc52b0-e01e-4913-aa50-da107c24830e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:57.240514 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-29fe14ad-97c7-4c10-a835-82bff2c677f5 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1318 microversion: 2.1 time: 0.168395 Jul 12 13:46:57.243000 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2fdc52b0-e01e-4913-aa50-da107c24830e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.243521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 336/680] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:57 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:57.244650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2fdc52b0-e01e-4913-aa50-da107c24830e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.245601 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2fdc52b0-e01e-4913-aa50-da107c24830e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.246211 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2fdc52b0-e01e-4913-aa50-da107c24830e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.255458 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-dda34ba9-f780-4ce7-9f80-e716b4d42869 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:57.256532 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-dda34ba9-f780-4ce7-9f80-e716b4d42869 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:57.270012 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dda34ba9-f780-4ce7-9f80-e716b4d42869 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.270686 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dda34ba9-f780-4ce7-9f80-e716b4d42869 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.271703 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dda34ba9-f780-4ce7-9f80-e716b4d42869 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.272144 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-dda34ba9-f780-4ce7-9f80-e716b4d42869 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.323526 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-dda34ba9-f780-4ce7-9f80-e716b4d42869 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072121 Jul 12 13:46:57.324093 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 337/681] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:46:57 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 13:46:57.386552 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-78091b1d-b257-404b-a33f-19b0c5cc0961 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:57.387340 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-78091b1d-b257-404b-a33f-19b0c5cc0961 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:57.393523 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-78091b1d-b257-404b-a33f-19b0c5cc0961 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.393984 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-78091b1d-b257-404b-a33f-19b0c5cc0961 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.394753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-78091b1d-b257-404b-a33f-19b0c5cc0961 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.395192 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-78091b1d-b257-404b-a33f-19b0c5cc0961 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.399153 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:57.422593 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-78091b1d-b257-404b-a33f-19b0c5cc0961 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:46:57.500276 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-78091b1d-b257-404b-a33f-19b0c5cc0961 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 204 len: 0 microversion: 2.1 time: 0.117917 Jul 12 13:46:57.501499 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 338/682] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:46:57 2022] DELETE /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:46:57.506814 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2fdc52b0-e01e-4913-aa50-da107c24830e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:57.512649 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1a05995f-8fc6-4b1d-8822-db2d8ab4db39 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:57.513357 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1a05995f-8fc6-4b1d-8822-db2d8ab4db39 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:57.517287 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2fdc52b0-e01e-4913-aa50-da107c24830e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:57.519171 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2fdc52b0-e01e-4913-aa50-da107c24830e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:57.519554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a05995f-8fc6-4b1d-8822-db2d8ab4db39 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.520007 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a05995f-8fc6-4b1d-8822-db2d8ab4db39 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.520783 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a05995f-8fc6-4b1d-8822-db2d8ab4db39 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.520893 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2fdc52b0-e01e-4913-aa50-da107c24830e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1405 microversion: 2.20 time: 0.293740 Jul 12 13:46:57.521222 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a05995f-8fc6-4b1d-8822-db2d8ab4db39 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.521851 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 345/683] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:57 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:57.658617 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1a05995f-8fc6-4b1d-8822-db2d8ab4db39 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:57.660162 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-07795f5b-840c-4efb-8553-68b9a28ad1d3 req-fc3c6588-a777-4b77-9880-2688ee72430d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7471c9e4-567e-4cea-b61e-03e316aa82f5", "tag": "876ef09a-81bf-4a1f-b2aa-4555e15e9a58"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:46:57.668430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1a05995f-8fc6-4b1d-8822-db2d8ab4db39 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1672 microversion: 2.1 time: 0.162264 Jul 12 13:46:57.669413 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-07795f5b-840c-4efb-8553-68b9a28ad1d3 req-fc3c6588-a777-4b77-9880-2688ee72430d service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:57.669930 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-07795f5b-840c-4efb-8553-68b9a28ad1d3 req-fc3c6588-a777-4b77-9880-2688ee72430d service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:57.678984 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 339/684] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:57 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:57.681647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-07795f5b-840c-4efb-8553-68b9a28ad1d3 req-fc3c6588-a777-4b77-9880-2688ee72430d service nova] Creating event network-changed:876ef09a-81bf-4a1f-b2aa-4555e15e9a58 for instance 7471c9e4-567e-4cea-b61e-03e316aa82f5 on hv-cinder-79797 Jul 12 13:46:57.686605 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-07795f5b-840c-4efb-8553-68b9a28ad1d3 req-fc3c6588-a777-4b77-9880-2688ee72430d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030295 Jul 12 13:46:57.687203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 346/685] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:46:58.260063 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-792cde8c-a025-4fbc-98b6-eb2326d3ed94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:58.260711 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-792cde8c-a025-4fbc-98b6-eb2326d3ed94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:58.267458 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-792cde8c-a025-4fbc-98b6-eb2326d3ed94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:58.267909 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-792cde8c-a025-4fbc-98b6-eb2326d3ed94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:58.268678 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-792cde8c-a025-4fbc-98b6-eb2326d3ed94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:58.269118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-792cde8c-a025-4fbc-98b6-eb2326d3ed94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:58.397773 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-792cde8c-a025-4fbc-98b6-eb2326d3ed94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:58.405983 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-792cde8c-a025-4fbc-98b6-eb2326d3ed94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1318 microversion: 2.1 time: 0.151130 Jul 12 13:46:58.406604 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 340/686] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:58 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:58.540119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-972c8e7a-c77d-4ad3-8972-91a411a924e9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:58.541202 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-972c8e7a-c77d-4ad3-8972-91a411a924e9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:58.547477 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-972c8e7a-c77d-4ad3-8972-91a411a924e9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:58.547931 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-972c8e7a-c77d-4ad3-8972-91a411a924e9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:58.548696 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-972c8e7a-c77d-4ad3-8972-91a411a924e9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:58.549139 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-972c8e7a-c77d-4ad3-8972-91a411a924e9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:58.685250 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-17589e84-0121-4f26-96ef-e739998fc4d2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:58.685867 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-17589e84-0121-4f26-96ef-e739998fc4d2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:58.687207 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-972c8e7a-c77d-4ad3-8972-91a411a924e9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:58.691847 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-17589e84-0121-4f26-96ef-e739998fc4d2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:58.692299 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-17589e84-0121-4f26-96ef-e739998fc4d2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:58.693068 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-17589e84-0121-4f26-96ef-e739998fc4d2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:58.693506 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-17589e84-0121-4f26-96ef-e739998fc4d2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:58.695261 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-972c8e7a-c77d-4ad3-8972-91a411a924e9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:58.697148 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-972c8e7a-c77d-4ad3-8972-91a411a924e9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:58.698332 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-972c8e7a-c77d-4ad3-8972-91a411a924e9 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1598 microversion: 2.20 time: 0.163033 Jul 12 13:46:58.698906 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 347/687] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:46:58 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:46:58.717779 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fa73450b-c671-46f5-b608-daacc81e3aae tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:58.718422 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fa73450b-c671-46f5-b608-daacc81e3aae tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:58.724571 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa73450b-c671-46f5-b608-daacc81e3aae tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:58.725096 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa73450b-c671-46f5-b608-daacc81e3aae tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:58.725875 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa73450b-c671-46f5-b608-daacc81e3aae tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:58.726408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa73450b-c671-46f5-b608-daacc81e3aae tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:58.743367 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:58.807325 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fa73450b-c671-46f5-b608-daacc81e3aae tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095901 Jul 12 13:46:58.808048 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 348/688] 10.222.0.52 () {60 vars in 1315 bytes} [Tue Jul 12 13:46:58 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:46:58.824194 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-17589e84-0121-4f26-96ef-e739998fc4d2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:58.832305 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-17589e84-0121-4f26-96ef-e739998fc4d2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1672 microversion: 2.1 time: 0.151530 Jul 12 13:46:58.832954 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 341/689] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:58 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:46:59.423259 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9cb82368-e13f-4003-ac3f-a94f459a735f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:59.423874 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9cb82368-e13f-4003-ac3f-a94f459a735f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:59.430557 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9cb82368-e13f-4003-ac3f-a94f459a735f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:59.431577 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9cb82368-e13f-4003-ac3f-a94f459a735f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:59.432377 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9cb82368-e13f-4003-ac3f-a94f459a735f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:59.432824 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9cb82368-e13f-4003-ac3f-a94f459a735f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:59.848575 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9cb82368-e13f-4003-ac3f-a94f459a735f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:46:59.855369 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-aaeee0a5-08b2-4587-8480-4479d1e5c13c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:46:59.855369 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-aaeee0a5-08b2-4587-8480-4479d1e5c13c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:46:59.862757 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9cb82368-e13f-4003-ac3f-a94f459a735f tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1318 microversion: 2.1 time: 0.443265 Jul 12 13:46:59.863456 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 349/690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:59 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:46:59.875116 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-aaeee0a5-08b2-4587-8480-4479d1e5c13c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:59.876094 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-aaeee0a5-08b2-4587-8480-4479d1e5c13c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:46:59.877571 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-aaeee0a5-08b2-4587-8480-4479d1e5c13c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:46:59.878070 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-aaeee0a5-08b2-4587-8480-4479d1e5c13c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:00.023637 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-aaeee0a5-08b2-4587-8480-4479d1e5c13c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:00.032905 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-aaeee0a5-08b2-4587-8480-4479d1e5c13c tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1672 microversion: 2.1 time: 0.187400 Jul 12 13:47:00.033500 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 342/691] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:46:59 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:00.258677 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-2624236b-5a2e-48ec-976b-3a37d5c846d7 req-c46b11cd-f61b-44a6-a4e3-8f3715daa7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ae49d6-301e-4cf8-9037-3b59098c81c9", "tag": "f5b2cadb-da8b-47ae-8893-71246ab085ad"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:00.267751 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-2624236b-5a2e-48ec-976b-3a37d5c846d7 req-c46b11cd-f61b-44a6-a4e3-8f3715daa7dd service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:00.268495 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-2624236b-5a2e-48ec-976b-3a37d5c846d7 req-c46b11cd-f61b-44a6-a4e3-8f3715daa7dd service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:00.288543 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-2624236b-5a2e-48ec-976b-3a37d5c846d7 req-c46b11cd-f61b-44a6-a4e3-8f3715daa7dd service nova] Creating event network-changed:f5b2cadb-da8b-47ae-8893-71246ab085ad for instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 on hv-cinder-79797 Jul 12 13:47:00.293701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-2624236b-5a2e-48ec-976b-3a37d5c846d7 req-c46b11cd-f61b-44a6-a4e3-8f3715daa7dd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038865 Jul 12 13:47:00.294353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 350/692] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:00.880340 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8a6b03a3-6070-40ed-b4a9-0c5452700c63 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:00.881100 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8a6b03a3-6070-40ed-b4a9-0c5452700c63 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:00.888812 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a6b03a3-6070-40ed-b4a9-0c5452700c63 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:00.889637 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a6b03a3-6070-40ed-b4a9-0c5452700c63 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:00.890828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a6b03a3-6070-40ed-b4a9-0c5452700c63 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:00.891485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a6b03a3-6070-40ed-b4a9-0c5452700c63 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:01.050840 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8a6b03a3-6070-40ed-b4a9-0c5452700c63 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:01.051177 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e95d8286-da31-4080-a775-7f9c5dab8ead tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:01.051880 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e95d8286-da31-4080-a775-7f9c5dab8ead tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:01.058371 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e95d8286-da31-4080-a775-7f9c5dab8ead tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:01.058820 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e95d8286-da31-4080-a775-7f9c5dab8ead tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:01.059603 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e95d8286-da31-4080-a775-7f9c5dab8ead tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:01.060040 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e95d8286-da31-4080-a775-7f9c5dab8ead tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:01.060150 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8a6b03a3-6070-40ed-b4a9-0c5452700c63 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1318 microversion: 2.1 time: 0.183984 Jul 12 13:47:01.060914 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 343/693] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:00 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:01.307394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e95d8286-da31-4080-a775-7f9c5dab8ead tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:01.318439 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e95d8286-da31-4080-a775-7f9c5dab8ead tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1672 microversion: 2.1 time: 0.271895 Jul 12 13:47:01.329087 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 351/694] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:01 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1672 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:02.077160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5bf2eb8a-479d-4ec8-b8ae-b47683258de2 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:02.078394 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5bf2eb8a-479d-4ec8-b8ae-b47683258de2 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:02.088675 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5bf2eb8a-479d-4ec8-b8ae-b47683258de2 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:02.089455 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5bf2eb8a-479d-4ec8-b8ae-b47683258de2 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:02.090556 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5bf2eb8a-479d-4ec8-b8ae-b47683258de2 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:02.091206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5bf2eb8a-479d-4ec8-b8ae-b47683258de2 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:02.261664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5bf2eb8a-479d-4ec8-b8ae-b47683258de2 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:02.270160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5bf2eb8a-479d-4ec8-b8ae-b47683258de2 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1318 microversion: 2.1 time: 0.196717 Jul 12 13:47:02.271143 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 344/695] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:02 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:02.309776 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-ea941c67-0ee2-426d-8862-55be80c395a1 req-371461e2-b9a4-449e-b364-fcfb5462550a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b0cff6-7efa-4a5b-bcfa-e9e435a77da9", "name": "network-vif-deleted", "tag": "4596e2d0-f0f2-49b9-a0a8-ab69ee88ab56"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:02.320202 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ea941c67-0ee2-426d-8862-55be80c395a1 req-371461e2-b9a4-449e-b364-fcfb5462550a service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:02.320671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ea941c67-0ee2-426d-8862-55be80c395a1 req-371461e2-b9a4-449e-b364-fcfb5462550a service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:02.331899 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-ea941c67-0ee2-426d-8862-55be80c395a1 req-371461e2-b9a4-449e-b364-fcfb5462550a service nova] Creating event network-vif-deleted:4596e2d0-f0f2-49b9-a0a8-ab69ee88ab56 for instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 on hv-cinder-79797 Jul 12 13:47:02.336273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:02.337078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:02.337994 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-ea941c67-0ee2-426d-8862-55be80c395a1 req-371461e2-b9a4-449e-b364-fcfb5462550a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031250 Jul 12 13:47:02.338742 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 352/696] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:02.346547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:02.347008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:02.347789 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:02.348257 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:02.380853 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:02.381300 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:02.381806 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lazy-loading 'fault' on Instance uuid 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:02.422543 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:02.430080 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-22c2a792-20b7-44aa-92b4-f626220e9b72 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 200 len: 1327 microversion: 2.1 time: 0.097816 Jul 12 13:47:02.430970 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 345/697] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:02 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:03.288741 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ada78ac0-22d8-4674-98ec-fd59b5db632a tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:03.289378 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ada78ac0-22d8-4674-98ec-fd59b5db632a tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:03.295633 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ada78ac0-22d8-4674-98ec-fd59b5db632a tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:03.296085 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ada78ac0-22d8-4674-98ec-fd59b5db632a tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:03.296859 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ada78ac0-22d8-4674-98ec-fd59b5db632a tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:03.297302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ada78ac0-22d8-4674-98ec-fd59b5db632a tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:03.439736 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ada78ac0-22d8-4674-98ec-fd59b5db632a tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:03.447807 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-246d17f7-d678-4029-9f7b-ff803d4f3c17 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:03.448280 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ada78ac0-22d8-4674-98ec-fd59b5db632a tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1318 microversion: 2.1 time: 0.163686 Jul 12 13:47:03.448409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-246d17f7-d678-4029-9f7b-ff803d4f3c17 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:03.448757 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 353/698] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:03 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:03.455170 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-246d17f7-d678-4029-9f7b-ff803d4f3c17 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:03.455613 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-246d17f7-d678-4029-9f7b-ff803d4f3c17 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:03.456552 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-246d17f7-d678-4029-9f7b-ff803d4f3c17 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:03.456990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-246d17f7-d678-4029-9f7b-ff803d4f3c17 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:03.470098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-246d17f7-d678-4029-9f7b-ff803d4f3c17 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] HTTP exception thrown: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-246d17f7-d678-4029-9f7b-ff803d4f3c17 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Request method failure captured: Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 HTTP/1.1 Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXoxhCc46UL_j1ts5vaVrgkT5bn-gAFQH8cj9TG7RHNxLBTWXG2_APR9_nZV025mEuypW9ejSvLgNoSZHSj1e8vgUaHF0Mx92g0hRtK4eMslFMrooNx4C9nDdxZuYql2BfSD3M54_pyY79qX4-eB2mjYu9i1GngOW_92-mQyrzFGmVo Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:47:03.471729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 2ad8ebe54a1d42eda9b23108f92a1d23 Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:47:03.473304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '56b0cff6-7efa-4a5b-bcfa-e9e435a77da9'} Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:47:03.474964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:47:03.476329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:03.477827 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-246d17f7-d678-4029-9f7b-ff803d4f3c17 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Returning 404 to user: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:47:03.477827 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-246d17f7-d678-4029-9f7b-ff803d4f3c17 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 404 len: 111 microversion: 2.1 time: 0.029691 Jul 12 13:47:03.477827 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 346/699] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:03 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:47:03.483222 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-130eaefd-a4c6-49dc-8e9f-4fd3142fafea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '.version_select at 0x7f3a164dc8b0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:03.517255 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-130eaefd-a4c6-49dc-8e9f-4fd3142fafea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235067066" status: 202 len: 0 microversion: 2.1 time: 0.037912 Jul 12 13:47:03.517930 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 354/700] 10.222.0.52 () {58 vars in 1217 bytes} [Tue Jul 12 13:47:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235067066 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:47:04.133460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4adef802-e4d5-4f41-85b7-4577c70096fe tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'create', calling method: .version_select at 0x7f3a15b9c820>, body: {"keypair": {"name": "tempest-keypair-1273323950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsqcWhqrC1O8HIQUEUsqMRzKh7vwwcFXBAItoo8j2zO968yCX3KcfdqtYyck2wZnGu4X/TMhUhssoiqammwN+yLwQNwXQrumbLpDenXS7g1TSC8XHnavckeQKe4Ap76kA=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:04.147426 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-4adef802-e4d5-4f41-85b7-4577c70096fe tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Getting quotas for project 5f431e3ab50a4133916f6175a2ef1b4f. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:47:04.151706 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-4adef802-e4d5-4f41-85b7-4577c70096fe tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Getting quotas for user 2ad8ebe54a1d42eda9b23108f92a1d23 and project 5f431e3ab50a4133916f6175a2ef1b4f. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:47:04.173519 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4adef802-e4d5-4f41-85b7-4577c70096fe tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043967 Jul 12 13:47:04.174152 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 347/701] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jul 12 13:47:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:04.466268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3837990a-8c2a-4976-8b33-3ff202ee85f9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:04.467505 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3837990a-8c2a-4976-8b33-3ff202ee85f9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:04.473524 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3837990a-8c2a-4976-8b33-3ff202ee85f9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:04.474007 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3837990a-8c2a-4976-8b33-3ff202ee85f9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:04.474787 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3837990a-8c2a-4976-8b33-3ff202ee85f9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:04.475236 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3837990a-8c2a-4976-8b33-3ff202ee85f9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:04.608831 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3837990a-8c2a-4976-8b33-3ff202ee85f9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:04.616443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3837990a-8c2a-4976-8b33-3ff202ee85f9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1318 microversion: 2.1 time: 0.155631 Jul 12 13:47:04.617098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 355/702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:04 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:05.481416 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-c438b29b-3360-407b-ad6c-812db21cc58e req-c6712927-848e-4d48-a11c-a495b40f42fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7471c9e4-567e-4cea-b61e-03e316aa82f5", "name": "network-vif-plugged", "status": "completed", "tag": "876ef09a-81bf-4a1f-b2aa-4555e15e9a58"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:05.494443 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-c438b29b-3360-407b-ad6c-812db21cc58e req-c6712927-848e-4d48-a11c-a495b40f42fa service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:05.494916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-c438b29b-3360-407b-ad6c-812db21cc58e req-c6712927-848e-4d48-a11c-a495b40f42fa service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:05.512900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-c438b29b-3360-407b-ad6c-812db21cc58e req-c6712927-848e-4d48-a11c-a495b40f42fa service nova] Creating event network-vif-plugged:876ef09a-81bf-4a1f-b2aa-4555e15e9a58 for instance 7471c9e4-567e-4cea-b61e-03e316aa82f5 on hv-cinder-79797 Jul 12 13:47:05.518830 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-c438b29b-3360-407b-ad6c-812db21cc58e req-c6712927-848e-4d48-a11c-a495b40f42fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042135 Jul 12 13:47:05.520229 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 348/703] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:05.634774 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ddd013c6-e994-403a-a912-8caff90fb00d tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:05.635699 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ddd013c6-e994-403a-a912-8caff90fb00d tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:05.639882 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:05.640539 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=8 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:05.647293 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ddd013c6-e994-403a-a912-8caff90fb00d tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:05.647796 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ddd013c6-e994-403a-a912-8caff90fb00d tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:05.648602 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ddd013c6-e994-403a-a912-8caff90fb00d tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:05.649042 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ddd013c6-e994-403a-a912-8caff90fb00d tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:05.725788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-929228370", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f4c68ad-9819-4d39-b28a-d626c5d607bf"}], "security_groups": [{"name": "tempest-securitygroup--1537734466"}], "key_name": "tempest-keypair-1273323950", "user_data": "}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:05.825994 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.network.neutron [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] validate_networks() for [('8f4c68ad-9819-4d39-b28a-d626c5d607bf', None, None, None, None, None)] {{(pid=124465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:47:05.838650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ddd013c6-e994-403a-a912-8caff90fb00d tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:05.846306 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ddd013c6-e994-403a-a912-8caff90fb00d tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1318 microversion: 2.1 time: 0.215504 Jul 12 13:47:05.846884 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 356/704] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:05 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:06.192030 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Flavor limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:47:06.192452 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Image limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:47:06.192922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Flavor pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:47:06.193330 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Image pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:47:06.193743 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:47:06.202638 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:06.203111 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:06.203906 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:06.204345 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:06.220902 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Getting quotas for project 5f431e3ab50a4133916f6175a2ef1b4f. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:47:06.223090 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:06.225745 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Getting quotas for user 2ad8ebe54a1d42eda9b23108f92a1d23 and project 5f431e3ab50a4133916f6175a2ef1b4f. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:47:06.239779 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Going to run 1 instances... {{(pid=124465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:47:06.242142 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:47:06.288714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bb5c483e-9941-4f38-98df-ed2373977084 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567387 Jul 12 13:47:06.290813 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 349/705] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:47:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 13:47:06.300519 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9048a4f7-13d4-4429-b6ef-885b7586a8e5 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:06.301119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9048a4f7-13d4-4429-b6ef-885b7586a8e5 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:06.355996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9048a4f7-13d4-4429-b6ef-885b7586a8e5 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:06.363027 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9048a4f7-13d4-4429-b6ef-885b7586a8e5 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1237 microversion: 2.1 time: 0.066133 Jul 12 13:47:06.363373 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 357/706] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:06 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:06.864614 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7b5e2288-0e14-425d-a6a3-65170f7bdd4b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:06.865231 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7b5e2288-0e14-425d-a6a3-65170f7bdd4b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:06.873069 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7b5e2288-0e14-425d-a6a3-65170f7bdd4b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:06.873517 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7b5e2288-0e14-425d-a6a3-65170f7bdd4b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:06.874326 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7b5e2288-0e14-425d-a6a3-65170f7bdd4b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:06.874761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7b5e2288-0e14-425d-a6a3-65170f7bdd4b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:07.014989 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7b5e2288-0e14-425d-a6a3-65170f7bdd4b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:07.022358 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7b5e2288-0e14-425d-a6a3-65170f7bdd4b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1318 microversion: 2.1 time: 0.162207 Jul 12 13:47:07.022925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 350/707] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:06 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:07.379033 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9a6c0d22-119e-4e84-96ae-224929b7346e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:07.379693 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9a6c0d22-119e-4e84-96ae-224929b7346e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:07.388797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a6c0d22-119e-4e84-96ae-224929b7346e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:07.389250 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a6c0d22-119e-4e84-96ae-224929b7346e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:07.390085 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a6c0d22-119e-4e84-96ae-224929b7346e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:07.390528 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a6c0d22-119e-4e84-96ae-224929b7346e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:07.451063 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9a6c0d22-119e-4e84-96ae-224929b7346e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:07.458515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9a6c0d22-119e-4e84-96ae-224929b7346e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1297 microversion: 2.1 time: 0.083654 Jul 12 13:47:07.459110 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 358/708] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:07 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:08.039807 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-23f82b67-786f-4227-a1f8-e8fa30f47224 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:08.040426 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-23f82b67-786f-4227-a1f8-e8fa30f47224 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:08.046969 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-23f82b67-786f-4227-a1f8-e8fa30f47224 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:08.047424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-23f82b67-786f-4227-a1f8-e8fa30f47224 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:08.048198 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-23f82b67-786f-4227-a1f8-e8fa30f47224 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:08.048638 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-23f82b67-786f-4227-a1f8-e8fa30f47224 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:08.175774 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-23f82b67-786f-4227-a1f8-e8fa30f47224 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:08.184295 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-23f82b67-786f-4227-a1f8-e8fa30f47224 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1507 microversion: 2.1 time: 0.148324 Jul 12 13:47:08.184872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 351/709] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:08 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:08.202038 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b079afe6-4cf0-4bfb-80e5-c019d1c75b3b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcddba0d-f4fb-4594-833f-190c1705abcd", "device": "/dev/sdb"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:08.203140 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b079afe6-4cf0-4bfb-80e5-c019d1c75b3b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:08.209049 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b079afe6-4cf0-4bfb-80e5-c019d1c75b3b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:08.209508 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b079afe6-4cf0-4bfb-80e5-c019d1c75b3b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:08.210326 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b079afe6-4cf0-4bfb-80e5-c019d1c75b3b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:08.210765 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b079afe6-4cf0-4bfb-80e5-c019d1c75b3b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:08.457371 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b079afe6-4cf0-4bfb-80e5-c019d1c75b3b tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "POST /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259576 Jul 12 13:47:08.458069 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 359/710] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:47:08 2022] POST /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:08.475561 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1a754ba6-88a7-409d-8b90-9766c2161c80 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:08.476179 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1a754ba6-88a7-409d-8b90-9766c2161c80 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:08.483473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a754ba6-88a7-409d-8b90-9766c2161c80 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:08.484370 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a754ba6-88a7-409d-8b90-9766c2161c80 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:08.485704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a754ba6-88a7-409d-8b90-9766c2161c80 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:08.487223 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1a754ba6-88a7-409d-8b90-9766c2161c80 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:08.657444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1a754ba6-88a7-409d-8b90-9766c2161c80 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:08.665868 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1a754ba6-88a7-409d-8b90-9766c2161c80 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.194030 Jul 12 13:47:08.666738 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 352/711] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:08 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:09.295783 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-59e1bae3-d5ef-41c0-b293-f7b97af48c1a req-0149a6a8-b624-45bb-af8b-a32049d2971e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a89058-e7f4-4e1a-8298-0fad022102c5", "tag": "d5b61525-52a9-47b4-b3c4-b4220a1b2359"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:09.317659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-59e1bae3-d5ef-41c0-b293-f7b97af48c1a req-0149a6a8-b624-45bb-af8b-a32049d2971e service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:09.319504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-59e1bae3-d5ef-41c0-b293-f7b97af48c1a req-0149a6a8-b624-45bb-af8b-a32049d2971e service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:09.335352 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-59e1bae3-d5ef-41c0-b293-f7b97af48c1a req-0149a6a8-b624-45bb-af8b-a32049d2971e service nova] Creating event network-changed:d5b61525-52a9-47b4-b3c4-b4220a1b2359 for instance a0a89058-e7f4-4e1a-8298-0fad022102c5 on hv-cinder-79797 Jul 12 13:47:09.347489 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-59e1bae3-d5ef-41c0-b293-f7b97af48c1a req-0149a6a8-b624-45bb-af8b-a32049d2971e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060426 Jul 12 13:47:09.348980 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 360/712] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:09.683765 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-02700fa4-d440-4250-a0f4-88ad3ef28b87 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:09.684375 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-02700fa4-d440-4250-a0f4-88ad3ef28b87 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:09.691029 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02700fa4-d440-4250-a0f4-88ad3ef28b87 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:09.691617 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02700fa4-d440-4250-a0f4-88ad3ef28b87 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:09.692418 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02700fa4-d440-4250-a0f4-88ad3ef28b87 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:09.692855 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02700fa4-d440-4250-a0f4-88ad3ef28b87 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:09.824931 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-02700fa4-d440-4250-a0f4-88ad3ef28b87 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:09.833058 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-02700fa4-d440-4250-a0f4-88ad3ef28b87 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.153608 Jul 12 13:47:09.833631 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 353/713] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:09 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:10.475285 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-64d338e2-ebc1-442e-9e73-ffd53ffa31a3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:10.475868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-64d338e2-ebc1-442e-9e73-ffd53ffa31a3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:10.483128 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d338e2-ebc1-442e-9e73-ffd53ffa31a3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:10.483581 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d338e2-ebc1-442e-9e73-ffd53ffa31a3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:10.484346 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d338e2-ebc1-442e-9e73-ffd53ffa31a3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:10.484794 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-64d338e2-ebc1-442e-9e73-ffd53ffa31a3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:10.508355 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-64d338e2-ebc1-442e-9e73-ffd53ffa31a3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/ips" status: 200 len: 148 microversion: 2.1 time: 0.037288 Jul 12 13:47:10.509552 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 361/714] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jul 12 13:47:10 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:10.908750 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-969e6397-cc47-440c-85af-9135586a96a2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:10.909355 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-969e6397-cc47-440c-85af-9135586a96a2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:10.915835 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-969e6397-cc47-440c-85af-9135586a96a2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:10.916280 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-969e6397-cc47-440c-85af-9135586a96a2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:10.917029 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-969e6397-cc47-440c-85af-9135586a96a2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:10.917459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-969e6397-cc47-440c-85af-9135586a96a2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:11.047121 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-969e6397-cc47-440c-85af-9135586a96a2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:11.054908 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-969e6397-cc47-440c-85af-9135586a96a2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.208999 Jul 12 13:47:11.055594 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 354/715] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:10 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:11.826648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-125d196b-8563-4206-9469-23fde11af85a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd724a52-54c6-4c31-b214-2fdc5b5bc133"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:11.827741 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-125d196b-8563-4206-9469-23fde11af85a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:11.834292 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-125d196b-8563-4206-9469-23fde11af85a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:11.834746 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-125d196b-8563-4206-9469-23fde11af85a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:11.835512 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-125d196b-8563-4206-9469-23fde11af85a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:11.835986 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-125d196b-8563-4206-9469-23fde11af85a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:12.071846 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b426bb36-1677-4357-8d9f-c436fdc166ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:12.072429 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b426bb36-1677-4357-8d9f-c436fdc166ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:12.079023 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b426bb36-1677-4357-8d9f-c436fdc166ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:12.079470 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b426bb36-1677-4357-8d9f-c436fdc166ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:12.080248 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b426bb36-1677-4357-8d9f-c436fdc166ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:12.080663 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-125d196b-8563-4206-9469-23fde11af85a tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257067 Jul 12 13:47:12.080772 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b426bb36-1677-4357-8d9f-c436fdc166ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:12.081282 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 362/716] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:47:11 2022] POST /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:12.225839 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b426bb36-1677-4357-8d9f-c436fdc166ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:12.229880 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:12.234951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b426bb36-1677-4357-8d9f-c436fdc166ea tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.166996 Jul 12 13:47:12.235521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 355/717] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:12 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:13.252932 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6dbe62bf-68eb-4cc7-a717-9b5929515815 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:13.253623 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6dbe62bf-68eb-4cc7-a717-9b5929515815 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:13.260851 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6dbe62bf-68eb-4cc7-a717-9b5929515815 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:13.261327 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6dbe62bf-68eb-4cc7-a717-9b5929515815 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:13.262395 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6dbe62bf-68eb-4cc7-a717-9b5929515815 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:13.262839 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6dbe62bf-68eb-4cc7-a717-9b5929515815 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:13.395400 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6dbe62bf-68eb-4cc7-a717-9b5929515815 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:13.402926 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6dbe62bf-68eb-4cc7-a717-9b5929515815 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.154425 Jul 12 13:47:13.403419 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 363/718] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:13 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:14.419583 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-2d7d86f1-65d7-4d03-9a02-6a006b00ccdb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:14.420193 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-2d7d86f1-65d7-4d03-9a02-6a006b00ccdb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:14.427933 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2d7d86f1-65d7-4d03-9a02-6a006b00ccdb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:14.428383 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2d7d86f1-65d7-4d03-9a02-6a006b00ccdb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:14.429138 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2d7d86f1-65d7-4d03-9a02-6a006b00ccdb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:14.429575 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2d7d86f1-65d7-4d03-9a02-6a006b00ccdb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:14.556334 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-2d7d86f1-65d7-4d03-9a02-6a006b00ccdb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:14.563701 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-2d7d86f1-65d7-4d03-9a02-6a006b00ccdb tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.147960 Jul 12 13:47:14.564263 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 356/719] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:14 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:15.581319 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1885296f-0c17-4787-b9ca-1412fbf17d62 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:15.581837 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1885296f-0c17-4787-b9ca-1412fbf17d62 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:15.588912 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1885296f-0c17-4787-b9ca-1412fbf17d62 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:15.589358 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1885296f-0c17-4787-b9ca-1412fbf17d62 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:15.590150 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1885296f-0c17-4787-b9ca-1412fbf17d62 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:15.590583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1885296f-0c17-4787-b9ca-1412fbf17d62 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:15.655485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-f1cc4fb6-e9d5-41cf-b7a2-562a709a64f9 req-4f7a17ce-1d06-46a5-a4b0-2e20149f18be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a89058-e7f4-4e1a-8298-0fad022102c5", "name": "network-vif-plugged", "status": "completed", "tag": "d5b61525-52a9-47b4-b3c4-b4220a1b2359"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:15.665877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-f1cc4fb6-e9d5-41cf-b7a2-562a709a64f9 req-4f7a17ce-1d06-46a5-a4b0-2e20149f18be service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:15.666352 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-f1cc4fb6-e9d5-41cf-b7a2-562a709a64f9 req-4f7a17ce-1d06-46a5-a4b0-2e20149f18be service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:15.679727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-f1cc4fb6-e9d5-41cf-b7a2-562a709a64f9 req-4f7a17ce-1d06-46a5-a4b0-2e20149f18be service nova] Creating event network-vif-plugged:d5b61525-52a9-47b4-b3c4-b4220a1b2359 for instance a0a89058-e7f4-4e1a-8298-0fad022102c5 on hv-cinder-79797 Jul 12 13:47:15.684754 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-f1cc4fb6-e9d5-41cf-b7a2-562a709a64f9 req-4f7a17ce-1d06-46a5-a4b0-2e20149f18be service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032917 Jul 12 13:47:15.685471 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 357/720] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:47:15.738245 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1885296f-0c17-4787-b9ca-1412fbf17d62 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:15.745942 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1885296f-0c17-4787-b9ca-1412fbf17d62 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.168909 Jul 12 13:47:15.746623 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 364/721] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:15 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:16.760480 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:16.761256 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=10 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:16.766271 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ea8ac1d1-bd05-405b-b695-4ee2896a0781 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:16.767160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ea8ac1d1-bd05-405b-b695-4ee2896a0781 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:16.774474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea8ac1d1-bd05-405b-b695-4ee2896a0781 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:16.774924 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea8ac1d1-bd05-405b-b695-4ee2896a0781 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:16.775684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea8ac1d1-bd05-405b-b695-4ee2896a0781 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:16.776119 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ea8ac1d1-bd05-405b-b695-4ee2896a0781 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:16.909477 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ea8ac1d1-bd05-405b-b695-4ee2896a0781 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:16.917547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ea8ac1d1-bd05-405b-b695-4ee2896a0781 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.158030 Jul 12 13:47:16.918138 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 358/722] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:16 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:17.934778 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e8dc56ca-ed58-4347-856a-f0035ea9e374 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:17.935387 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e8dc56ca-ed58-4347-856a-f0035ea9e374 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:17.937761 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:17.938466 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:17.944014 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8dc56ca-ed58-4347-856a-f0035ea9e374 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:17.944462 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8dc56ca-ed58-4347-856a-f0035ea9e374 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:17.945223 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8dc56ca-ed58-4347-856a-f0035ea9e374 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:17.945660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e8dc56ca-ed58-4347-856a-f0035ea9e374 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:18.073553 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e8dc56ca-ed58-4347-856a-f0035ea9e374 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:18.080911 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e8dc56ca-ed58-4347-856a-f0035ea9e374 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.150483 Jul 12 13:47:18.081465 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 365/723] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:17 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:19.097050 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1932fda7-6e29-4375-887e-e953f138c916 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:19.097649 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1932fda7-6e29-4375-887e-e953f138c916 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:19.104128 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1932fda7-6e29-4375-887e-e953f138c916 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:19.104580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1932fda7-6e29-4375-887e-e953f138c916 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:19.105348 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1932fda7-6e29-4375-887e-e953f138c916 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:19.105787 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1932fda7-6e29-4375-887e-e953f138c916 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:19.231728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1932fda7-6e29-4375-887e-e953f138c916 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:19.239135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1932fda7-6e29-4375-887e-e953f138c916 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.146009 Jul 12 13:47:19.239702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 359/724] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:19 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:20.256770 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-facbfcec-fd29-4f70-8c62-e4adef562067 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:20.257512 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-facbfcec-fd29-4f70-8c62-e4adef562067 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:20.264575 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-facbfcec-fd29-4f70-8c62-e4adef562067 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:20.265020 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-facbfcec-fd29-4f70-8c62-e4adef562067 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:20.265774 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-facbfcec-fd29-4f70-8c62-e4adef562067 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:20.266237 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-facbfcec-fd29-4f70-8c62-e4adef562067 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:20.401752 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-facbfcec-fd29-4f70-8c62-e4adef562067 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:20.409222 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-facbfcec-fd29-4f70-8c62-e4adef562067 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1363 microversion: 2.1 time: 0.156306 Jul 12 13:47:20.409789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 366/725] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:20 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:21.426400 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1ddf3336-487a-41e6-a756-dbc544859065 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:21.427013 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1ddf3336-487a-41e6-a756-dbc544859065 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:21.434322 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ddf3336-487a-41e6-a756-dbc544859065 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:21.434780 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ddf3336-487a-41e6-a756-dbc544859065 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:21.435546 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ddf3336-487a-41e6-a756-dbc544859065 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:21.435985 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1ddf3336-487a-41e6-a756-dbc544859065 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:21.562884 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1ddf3336-487a-41e6-a756-dbc544859065 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:21.570273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1ddf3336-487a-41e6-a756-dbc544859065 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1549 microversion: 2.1 time: 0.147652 Jul 12 13:47:21.570858 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 360/726] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:21 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:21.586946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5588b944-f74c-49ba-8f80-1925ac1b14cf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:21.587451 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5588b944-f74c-49ba-8f80-1925ac1b14cf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:21.593879 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5588b944-f74c-49ba-8f80-1925ac1b14cf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:21.594359 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5588b944-f74c-49ba-8f80-1925ac1b14cf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:21.595122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5588b944-f74c-49ba-8f80-1925ac1b14cf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:21.595561 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5588b944-f74c-49ba-8f80-1925ac1b14cf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:21.599570 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:21.680754 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5588b944-f74c-49ba-8f80-1925ac1b14cf tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097175 Jul 12 13:47:21.681335 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 367/727] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jul 12 13:47:21 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:22.877682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-fab24d2d-6620-4077-a2dd-359e606b689d req-11b4d345-e569-4efd-840d-1695b5410583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a89058-e7f4-4e1a-8298-0fad022102c5", "tag": "d5b61525-52a9-47b4-b3c4-b4220a1b2359"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:22.885566 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-fab24d2d-6620-4077-a2dd-359e606b689d req-11b4d345-e569-4efd-840d-1695b5410583 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:22.886104 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-fab24d2d-6620-4077-a2dd-359e606b689d req-11b4d345-e569-4efd-840d-1695b5410583 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:22.896890 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-fab24d2d-6620-4077-a2dd-359e606b689d req-11b4d345-e569-4efd-840d-1695b5410583 service nova] Creating event network-changed:d5b61525-52a9-47b4-b3c4-b4220a1b2359 for instance a0a89058-e7f4-4e1a-8298-0fad022102c5 on hv-cinder-79797 Jul 12 13:47:22.902225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-fab24d2d-6620-4077-a2dd-359e606b689d req-11b4d345-e569-4efd-840d-1695b5410583 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083033 Jul 12 13:47:22.902812 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 361/728] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:24.894059 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bbeaeadc-21e9-48b2-9ddc-af891a846fa5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd724a52-54c6-4c31-b214-2fdc5b5bc133"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:24.895334 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bbeaeadc-21e9-48b2-9ddc-af891a846fa5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:24.902150 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbeaeadc-21e9-48b2-9ddc-af891a846fa5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:24.902778 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbeaeadc-21e9-48b2-9ddc-af891a846fa5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:24.903539 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbeaeadc-21e9-48b2-9ddc-af891a846fa5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:24.904074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbeaeadc-21e9-48b2-9ddc-af891a846fa5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:24.983145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-bbeaeadc-21e9-48b2-9ddc-af891a846fa5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Invalid volume: volume cd724a52-54c6-4c31-b214-2fdc5b5bc133 is already attached to instances: 84876f50-f017-42db-8784-05787e987508 Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bbeaeadc-21e9-48b2-9ddc-af891a846fa5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: POST /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments HTTP/1.1 Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 74 Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:47:24.984868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {"volumeAttachment": {"volumeId": "cd724a52-54c6-4c31-b214-2fdc5b5bc133"}} Jul 12 13:47:24.986546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Invalid volume: volume cd724a52-54c6-4c31-b214-2fdc5b5bc133 is already attached to instances: 84876f50-f017-42db-8784-05787e987508 Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'server_id': '84876f50-f017-42db-8784-05787e987508', 'body': {'volumeAttachment': {'volumeId': 'cd724a52-54c6-4c31-b214-2fdc5b5bc133'}}} Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cd724a52-54c6-4c31-b214-2fdc5b5bc133 is already attached to instances: 84876f50-f017-42db-8784-05787e987508 Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:47:24.987476 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cd724a52-54c6-4c31-b214-2fdc5b5bc133 is already attached to instances: 84876f50-f017-42db-8784-05787e987508 Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:24.988901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:24.990428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:24.990428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:47:24.990428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:47:24.990428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cd724a52-54c6-4c31-b214-2fdc5b5bc133 is already attached to instances: 84876f50-f017-42db-8784-05787e987508 Jul 12 13:47:24.990428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:47:24.990428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bbeaeadc-21e9-48b2-9ddc-af891a846fa5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 400 to user: Invalid volume: volume cd724a52-54c6-4c31-b214-2fdc5b5bc133 is already attached to instances: 84876f50-f017-42db-8784-05787e987508 {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:47:24.990428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bbeaeadc-21e9-48b2-9ddc-af891a846fa5 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096935 Jul 12 13:47:24.990428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 368/729] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:47:24 2022] POST /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:47:25.048736 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-9b1da505-5581-4804-b537-4ca0f0e2bf91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:25.049311 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-9b1da505-5581-4804-b537-4ca0f0e2bf91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:25.055459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9b1da505-5581-4804-b537-4ca0f0e2bf91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:25.055906 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9b1da505-5581-4804-b537-4ca0f0e2bf91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:25.056655 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9b1da505-5581-4804-b537-4ca0f0e2bf91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:25.057095 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9b1da505-5581-4804-b537-4ca0f0e2bf91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:25.138765 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-9b1da505-5581-4804-b537-4ca0f0e2bf91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lazy-loading 'services' on Instance uuid 84876f50-f017-42db-8784-05787e987508 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:25.212076 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-9b1da505-5581-4804-b537-4ca0f0e2bf91 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments/cd724a52-54c6-4c31-b214-2fdc5b5bc133" status: 202 len: 0 microversion: 2.1 time: 0.167878 Jul 12 13:47:25.212738 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 362/730] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:47:25 2022] DELETE /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments/cd724a52-54c6-4c31-b214-2fdc5b5bc133 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:47:25.221275 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8027fc9f-e26d-467b-ad91-d8ab3dba66d7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:25.222237 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8027fc9f-e26d-467b-ad91-d8ab3dba66d7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:25.229451 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8027fc9f-e26d-467b-ad91-d8ab3dba66d7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:25.229983 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8027fc9f-e26d-467b-ad91-d8ab3dba66d7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:25.230761 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8027fc9f-e26d-467b-ad91-d8ab3dba66d7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:25.231257 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8027fc9f-e26d-467b-ad91-d8ab3dba66d7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:25.262474 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8027fc9f-e26d-467b-ad91-d8ab3dba66d7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Jul 12 13:47:25.263044 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 369/731] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:47:25 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:26.275998 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ce1e9112-1c5b-465f-9f07-b3ccf1aefeb7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:26.277041 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ce1e9112-1c5b-465f-9f07-b3ccf1aefeb7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:26.283218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ce1e9112-1c5b-465f-9f07-b3ccf1aefeb7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:26.283661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ce1e9112-1c5b-465f-9f07-b3ccf1aefeb7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:26.284408 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ce1e9112-1c5b-465f-9f07-b3ccf1aefeb7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:26.284837 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ce1e9112-1c5b-465f-9f07-b3ccf1aefeb7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:26.312309 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ce1e9112-1c5b-465f-9f07-b3ccf1aefeb7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041672 Jul 12 13:47:26.312863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 363/732] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:47:26 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:47:26.368442 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-50247257-e130-47c7-b699-3e66266551ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:26.368940 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-50247257-e130-47c7-b699-3e66266551ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:26.375424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50247257-e130-47c7-b699-3e66266551ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:26.375873 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50247257-e130-47c7-b699-3e66266551ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:26.376655 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50247257-e130-47c7-b699-3e66266551ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:26.377333 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-50247257-e130-47c7-b699-3e66266551ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:26.402408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-50247257-e130-47c7-b699-3e66266551ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:47:26.473701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-50247257-e130-47c7-b699-3e66266551ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 204 len: 0 microversion: 2.1 time: 0.108837 Jul 12 13:47:26.474498 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 370/733] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:47:26 2022] DELETE /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:47:26.482922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e6428b24-5e2c-4d2a-8d87-80738e5a109d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:26.483575 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e6428b24-5e2c-4d2a-8d87-80738e5a109d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:26.489562 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e6428b24-5e2c-4d2a-8d87-80738e5a109d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:26.489979 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e6428b24-5e2c-4d2a-8d87-80738e5a109d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:26.490760 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e6428b24-5e2c-4d2a-8d87-80738e5a109d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:26.491194 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e6428b24-5e2c-4d2a-8d87-80738e5a109d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:26.620579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e6428b24-5e2c-4d2a-8d87-80738e5a109d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:26.628269 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e6428b24-5e2c-4d2a-8d87-80738e5a109d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1678 microversion: 2.1 time: 0.149161 Jul 12 13:47:26.628844 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 364/734] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:26 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:27.646760 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aa261aaf-ef22-41ef-a0c5-1ccb5a071493 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:27.647463 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aa261aaf-ef22-41ef-a0c5-1ccb5a071493 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:27.653906 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa261aaf-ef22-41ef-a0c5-1ccb5a071493 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:27.654389 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa261aaf-ef22-41ef-a0c5-1ccb5a071493 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:27.655155 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa261aaf-ef22-41ef-a0c5-1ccb5a071493 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:27.655593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa261aaf-ef22-41ef-a0c5-1ccb5a071493 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:27.760516 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8a70eca3-abbf-4364-9d07-6de100ba99ac tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:27.761103 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8a70eca3-abbf-4364-9d07-6de100ba99ac tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:27.767827 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a70eca3-abbf-4364-9d07-6de100ba99ac tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:27.768352 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a70eca3-abbf-4364-9d07-6de100ba99ac tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:27.769197 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a70eca3-abbf-4364-9d07-6de100ba99ac tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:27.769707 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8a70eca3-abbf-4364-9d07-6de100ba99ac tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:27.791349 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-aa261aaf-ef22-41ef-a0c5-1ccb5a071493 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:27.799087 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aa261aaf-ef22-41ef-a0c5-1ccb5a071493 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1678 microversion: 2.1 time: 0.156549 Jul 12 13:47:27.799651 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 371/735] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:27 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:27.847895 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-8a70eca3-abbf-4364-9d07-6de100ba99ac tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lazy-loading 'services' on Instance uuid 7471c9e4-567e-4cea-b61e-03e316aa82f5 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:27.919247 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8a70eca3-abbf-4364-9d07-6de100ba99ac tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5/os-volume_attachments/dcddba0d-f4fb-4594-833f-190c1705abcd" status: 202 len: 0 microversion: 2.1 time: 0.163179 Jul 12 13:47:27.919817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 365/736] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:47:27 2022] DELETE /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5/os-volume_attachments/dcddba0d-f4fb-4594-833f-190c1705abcd => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 13:47:28.816806 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-457aafe2-8ff1-4d52-8923-272b02843149 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:28.817398 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-457aafe2-8ff1-4d52-8923-272b02843149 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:28.825241 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-457aafe2-8ff1-4d52-8923-272b02843149 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:28.825873 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-457aafe2-8ff1-4d52-8923-272b02843149 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:28.826868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-457aafe2-8ff1-4d52-8923-272b02843149 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:28.827326 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-457aafe2-8ff1-4d52-8923-272b02843149 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:29.047331 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-457aafe2-8ff1-4d52-8923-272b02843149 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:29.057077 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-457aafe2-8ff1-4d52-8923-272b02843149 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1678 microversion: 2.1 time: 0.244081 Jul 12 13:47:29.057980 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 372/737] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:28 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:29.360347 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3dc36459-33a3-4795-85e4-e5f321bd64d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:29.360930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3dc36459-33a3-4795-85e4-e5f321bd64d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:29.367390 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3dc36459-33a3-4795-85e4-e5f321bd64d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:29.368393 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3dc36459-33a3-4795-85e4-e5f321bd64d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:29.369150 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3dc36459-33a3-4795-85e4-e5f321bd64d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:29.369585 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3dc36459-33a3-4795-85e4-e5f321bd64d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:29.457552 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-3dc36459-33a3-4795-85e4-e5f321bd64d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lazy-loading 'services' on Instance uuid f42ee030-0bf1-402b-b7f4-9c9a33ac5aee {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:29.535834 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3dc36459-33a3-4795-85e4-e5f321bd64d5 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments/1c220d30-796c-4644-a6d2-2bfdad0a7cdc" status: 202 len: 0 microversion: 2.1 time: 0.180223 Jul 12 13:47:29.537597 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 366/738] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:47:29 2022] DELETE /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments/1c220d30-796c-4644-a6d2-2bfdad0a7cdc => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:47:29.546558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7071963b-b9b1-41fe-a252-0e9ed55ab637 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:29.547690 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7071963b-b9b1-41fe-a252-0e9ed55ab637 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:29.554298 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7071963b-b9b1-41fe-a252-0e9ed55ab637 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:29.554737 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7071963b-b9b1-41fe-a252-0e9ed55ab637 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:29.556359 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7071963b-b9b1-41fe-a252-0e9ed55ab637 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:29.556838 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7071963b-b9b1-41fe-a252-0e9ed55ab637 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:29.590935 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7071963b-b9b1-41fe-a252-0e9ed55ab637 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048503 Jul 12 13:47:29.591619 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 373/739] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:47:29 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:29.676187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-f5d7b5d0-29d0-42c7-bb95-cb7892640f8e req-c2b972ec-f7ea-486e-b3f7-f077586fb18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84876f50-f017-42db-8784-05787e987508", "name": "network-vif-deleted", "tag": "cd8b2ad0-77dc-4353-9c90-05d7f2a4da54"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:29.684846 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-f5d7b5d0-29d0-42c7-bb95-cb7892640f8e req-c2b972ec-f7ea-486e-b3f7-f077586fb18c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:29.685298 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-f5d7b5d0-29d0-42c7-bb95-cb7892640f8e req-c2b972ec-f7ea-486e-b3f7-f077586fb18c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:29.704056 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-f5d7b5d0-29d0-42c7-bb95-cb7892640f8e req-c2b972ec-f7ea-486e-b3f7-f077586fb18c service nova] Creating event network-vif-deleted:cd8b2ad0-77dc-4353-9c90-05d7f2a4da54 for instance 84876f50-f017-42db-8784-05787e987508 on hv-cinder-79797 Jul 12 13:47:29.709671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-f5d7b5d0-29d0-42c7-bb95-cb7892640f8e req-c2b972ec-f7ea-486e-b3f7-f077586fb18c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037229 Jul 12 13:47:29.710489 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 367/740] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:30.075495 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:30.077279 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:30.084175 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4d2e0ee7-b6d0-4064-9c1a-5a278cf8db94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:30.084756 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4d2e0ee7-b6d0-4064-9c1a-5a278cf8db94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:30.092318 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4d2e0ee7-b6d0-4064-9c1a-5a278cf8db94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:30.094180 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:30.094816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:30.095750 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:30.096659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:30.097696 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4d2e0ee7-b6d0-4064-9c1a-5a278cf8db94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:30.099872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4d2e0ee7-b6d0-4064-9c1a-5a278cf8db94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:30.102642 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4d2e0ee7-b6d0-4064-9c1a-5a278cf8db94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:30.141546 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4d2e0ee7-b6d0-4064-9c1a-5a278cf8db94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:47:30.142040 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:30.142590 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:30.143262 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lazy-loading 'fault' on Instance uuid 84876f50-f017-42db-8784-05787e987508 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:30.185896 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:30.197391 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f67c8ebe-3a91-4050-a3ac-55392697f211 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1330 microversion: 2.1 time: 0.126649 Jul 12 13:47:30.197995 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 374/741] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:30 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1330 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:30.229232 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4d2e0ee7-b6d0-4064-9c1a-5a278cf8db94 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 204 len: 0 microversion: 2.1 time: 0.148895 Jul 12 13:47:30.229825 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 368/742] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:47:30 2022] DELETE /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 13:47:30.238055 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1a75df9b-fb37-4a4d-8bf3-aec081cf4ab8 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:30.238666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1a75df9b-fb37-4a4d-8bf3-aec081cf4ab8 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:30.244999 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a75df9b-fb37-4a4d-8bf3-aec081cf4ab8 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:30.245478 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a75df9b-fb37-4a4d-8bf3-aec081cf4ab8 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:30.246268 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a75df9b-fb37-4a4d-8bf3-aec081cf4ab8 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:30.246704 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1a75df9b-fb37-4a4d-8bf3-aec081cf4ab8 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:30.375848 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1a75df9b-fb37-4a4d-8bf3-aec081cf4ab8 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:30.384126 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1a75df9b-fb37-4a4d-8bf3-aec081cf4ab8 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1513 microversion: 2.1 time: 0.149989 Jul 12 13:47:30.384703 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 375/743] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:30 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:30.604347 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f720384e-21d0-47d3-9997-a91e9e725448 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:30.605445 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f720384e-21d0-47d3-9997-a91e9e725448 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:30.612280 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f720384e-21d0-47d3-9997-a91e9e725448 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:30.612738 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f720384e-21d0-47d3-9997-a91e9e725448 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:30.613516 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f720384e-21d0-47d3-9997-a91e9e725448 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:30.613985 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-f720384e-21d0-47d3-9997-a91e9e725448 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:30.646971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f720384e-21d0-47d3-9997-a91e9e725448 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047287 Jul 12 13:47:30.647823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 369/744] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:47:30 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:47:31.215872 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:31.216508 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:31.222992 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:31.223446 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:31.224213 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:31.224680 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:31.255341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:31.255792 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:31.256243 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lazy-loading 'fault' on Instance uuid 84876f50-f017-42db-8784-05787e987508 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:31.296596 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:31.303929 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fa1234fe-7580-4050-932e-8f1c4392d205 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 200 len: 1330 microversion: 2.1 time: 0.092454 Jul 12 13:47:31.304503 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 376/745] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:31 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:31.401666 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ddbe345a-ae73-45e4-ba1f-b1fd95897fa9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:31.402317 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ddbe345a-ae73-45e4-ba1f-b1fd95897fa9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:31.408423 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ddbe345a-ae73-45e4-ba1f-b1fd95897fa9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:31.408870 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ddbe345a-ae73-45e4-ba1f-b1fd95897fa9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:31.409626 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ddbe345a-ae73-45e4-ba1f-b1fd95897fa9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:31.410084 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ddbe345a-ae73-45e4-ba1f-b1fd95897fa9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:31.536307 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ddbe345a-ae73-45e4-ba1f-b1fd95897fa9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:31.539854 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:31.545403 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ddbe345a-ae73-45e4-ba1f-b1fd95897fa9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1513 microversion: 2.1 time: 0.148008 Jul 12 13:47:31.545998 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 370/746] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:31 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:31.659796 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a0a14ba3-670a-4676-8c45-aca5e6a95c71 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:31.660716 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a0a14ba3-670a-4676-8c45-aca5e6a95c71 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:31.667314 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0a14ba3-670a-4676-8c45-aca5e6a95c71 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:31.667773 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0a14ba3-670a-4676-8c45-aca5e6a95c71 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:31.668542 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0a14ba3-670a-4676-8c45-aca5e6a95c71 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:31.668987 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a0a14ba3-670a-4676-8c45-aca5e6a95c71 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:31.697701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a0a14ba3-670a-4676-8c45-aca5e6a95c71 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041962 Jul 12 13:47:31.698320 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 377/747] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:47:31 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:32.320789 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-65c721fd-81eb-4115-8252-f2dad7c6a9ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:32.321409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-65c721fd-81eb-4115-8252-f2dad7c6a9ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:32.330376 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-65c721fd-81eb-4115-8252-f2dad7c6a9ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.330833 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-65c721fd-81eb-4115-8252-f2dad7c6a9ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:32.331611 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-65c721fd-81eb-4115-8252-f2dad7c6a9ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.332052 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-65c721fd-81eb-4115-8252-f2dad7c6a9ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:32.346596 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-65c721fd-81eb-4115-8252-f2dad7c6a9ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-65c721fd-81eb-4115-8252-f2dad7c6a9ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 HTTP/1.1 Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:47:32.348251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:47:32.349739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '84876f50-f017-42db-8784-05787e987508'} Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:47:32.350581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:47:32.352065 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:32.353122 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-65c721fd-81eb-4115-8252-f2dad7c6a9ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:47:32.353122 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-65c721fd-81eb-4115-8252-f2dad7c6a9ab tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 404 len: 111 microversion: 2.1 time: 0.032827 Jul 12 13:47:32.353122 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 371/748] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:32 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:47:32.358812 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c3f34d6f-506f-4f69-b145-3bab9de511aa tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '.version_select at 0x7f3a164dc310>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:32.376590 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c3f34d6f-506f-4f69-b145-3bab9de511aa tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133068301" status: 202 len: 0 microversion: 2.1 time: 0.021852 Jul 12 13:47:32.380842 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 378/749] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jul 12 13:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2133068301 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:47:32.562644 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-54a1737c-83bc-448b-98fa-af6cc14668d7 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:32.563692 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-54a1737c-83bc-448b-98fa-af6cc14668d7 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:32.570854 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-54a1737c-83bc-448b-98fa-af6cc14668d7 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.573334 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-54a1737c-83bc-448b-98fa-af6cc14668d7 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:32.574355 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-54a1737c-83bc-448b-98fa-af6cc14668d7 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.575030 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-54a1737c-83bc-448b-98fa-af6cc14668d7 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:32.673061 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-54a1737c-83bc-448b-98fa-af6cc14668d7 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:32.684198 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-54a1737c-83bc-448b-98fa-af6cc14668d7 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1471 microversion: 2.1 time: 0.125818 Jul 12 13:47:32.686076 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 372/750] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:32 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1471 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:32.709537 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-383df41e-1d86-4fc7-8998-f35d9d634823 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:32.710812 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-383df41e-1d86-4fc7-8998-f35d9d634823 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:32.715936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-1a7fa09b-f632-4b2e-8e53-a0578f2cbbb2 req-a94c44ed-251a-4c5d-9a37-ca79f1fb2ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7471c9e4-567e-4cea-b61e-03e316aa82f5", "name": "network-vif-deleted", "tag": "876ef09a-81bf-4a1f-b2aa-4555e15e9a58"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:32.718510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-383df41e-1d86-4fc7-8998-f35d9d634823 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.719221 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-383df41e-1d86-4fc7-8998-f35d9d634823 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:32.720160 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-383df41e-1d86-4fc7-8998-f35d9d634823 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.720864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-383df41e-1d86-4fc7-8998-f35d9d634823 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:32.725160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-1a7fa09b-f632-4b2e-8e53-a0578f2cbbb2 req-a94c44ed-251a-4c5d-9a37-ca79f1fb2ea3 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.725602 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-1a7fa09b-f632-4b2e-8e53-a0578f2cbbb2 req-a94c44ed-251a-4c5d-9a37-ca79f1fb2ea3 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:32.750482 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-1a7fa09b-f632-4b2e-8e53-a0578f2cbbb2 req-a94c44ed-251a-4c5d-9a37-ca79f1fb2ea3 service nova] Creating event network-vif-deleted:876ef09a-81bf-4a1f-b2aa-4555e15e9a58 for instance 7471c9e4-567e-4cea-b61e-03e316aa82f5 on hv-cinder-79797 Jul 12 13:47:32.752924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-383df41e-1d86-4fc7-8998-f35d9d634823 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047313 Jul 12 13:47:32.754041 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 379/751] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:47:32 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:47:32.757016 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-1a7fa09b-f632-4b2e-8e53-a0578f2cbbb2 req-a94c44ed-251a-4c5d-9a37-ca79f1fb2ea3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044557 Jul 12 13:47:32.757755 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 373/752] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:32.835090 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3024b739-04c8-474d-b05b-e5de5b5f38b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:32.835474 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3024b739-04c8-474d-b05b-e5de5b5f38b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:32.842486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3024b739-04c8-474d-b05b-e5de5b5f38b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.843233 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3024b739-04c8-474d-b05b-e5de5b5f38b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:32.844393 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3024b739-04c8-474d-b05b-e5de5b5f38b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.845096 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3024b739-04c8-474d-b05b-e5de5b5f38b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:32.875218 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3024b739-04c8-474d-b05b-e5de5b5f38b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:47:32.952371 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3024b739-04c8-474d-b05b-e5de5b5f38b1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 204 len: 0 microversion: 2.1 time: 0.122527 Jul 12 13:47:32.952966 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 380/753] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:47:32 2022] DELETE /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:47:32.961359 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-49bd41d2-3393-4b49-9b03-dda640894262 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:32.962218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-49bd41d2-3393-4b49-9b03-dda640894262 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:32.968618 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-49bd41d2-3393-4b49-9b03-dda640894262 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.969068 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-49bd41d2-3393-4b49-9b03-dda640894262 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:32.969837 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-49bd41d2-3393-4b49-9b03-dda640894262 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:32.970683 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-49bd41d2-3393-4b49-9b03-dda640894262 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:33.167544 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-574bc702-7857-4d92-bd02-cc8768589d3f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: .version_select at 0x7f3a165aeee0>, body: {"keypair": {"name": "tempest-keypair-1679654482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNxsUBJ+0ZafcD2CD8xb+flGp4enon7yDwrsAUL2KF2UkWBOqny9nXefUPYqIYNovJd8D1lJqQFOwpBfI+UBjkqiTzFvP3EmQ+JVurdHZTQHfve8VPv+qty7ZsKVj4/jg=="}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:33.171987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-49bd41d2-3393-4b49-9b03-dda640894262 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:33.179717 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-49bd41d2-3393-4b49-9b03-dda640894262 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1689 microversion: 2.1 time: 0.222485 Jul 12 13:47:33.180281 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 374/754] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:32 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:33.193902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-574bc702-7857-4d92-bd02-cc8768589d3f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for project c4e88457b140443093476f9b6d9bcff4. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:47:33.197819 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-574bc702-7857-4d92-bd02-cc8768589d3f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for user a892b2511463404c818c63e870a23389 and project c4e88457b140443093476f9b6d9bcff4. Resources: {'key_pairs'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:47:33.220108 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-574bc702-7857-4d92-bd02-cc8768589d3f tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057412 Jul 12 13:47:33.220714 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 381/755] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jul 12 13:47:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:47:33.702644 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:33.703371 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:33.710625 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:33.711170 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:33.712002 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:33.712988 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:33.743836 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:33.744279 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:33.744726 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lazy-loading 'fault' on Instance uuid 7471c9e4-567e-4cea-b61e-03e316aa82f5 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:33.793559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:33.800995 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5c99ea0d-9997-47e1-ac89-3c66b87362af tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1308 microversion: 2.1 time: 0.102178 Jul 12 13:47:33.801552 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 375/756] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:33 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:34.198005 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f3e9e574-7493-4794-a93b-7b91e23032c6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:34.198772 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f3e9e574-7493-4794-a93b-7b91e23032c6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:34.205129 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3e9e574-7493-4794-a93b-7b91e23032c6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:34.205585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3e9e574-7493-4794-a93b-7b91e23032c6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:34.206397 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3e9e574-7493-4794-a93b-7b91e23032c6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:34.206843 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3e9e574-7493-4794-a93b-7b91e23032c6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:34.211362 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:34.341589 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f3e9e574-7493-4794-a93b-7b91e23032c6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:34.350034 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f3e9e574-7493-4794-a93b-7b91e23032c6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1689 microversion: 2.1 time: 0.157024 Jul 12 13:47:34.350620 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 382/757] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:34 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:34.459196 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-162631008", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0de195dd-d448-4ed3-8684-a2fd07757acb"}], "security_groups": [{"name": "tempest-securitygroup--1694453402"}], "key_name": "tempest-keypair-1679654482", "user_data": "}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:34.558189 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.network.neutron [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] validate_networks() for [('0de195dd-d448-4ed3-8684-a2fd07757acb', None, None, None, None, None)] {{(pid=124465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:47:34.818077 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:34.818693 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:34.824773 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:34.825227 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:34.826025 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:34.826474 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:34.859723 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:34.860180 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:34.860638 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lazy-loading 'fault' on Instance uuid 7471c9e4-567e-4cea-b61e-03e316aa82f5 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:34.901634 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:34.909481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c3ccbc69-4d79-4d45-852f-e38c050eff65 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1308 microversion: 2.1 time: 0.095230 Jul 12 13:47:34.910426 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 383/758] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:34 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:34.971133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Flavor limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:47:34.971600 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Image limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:47:34.972035 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Flavor pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:47:34.972448 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Image pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:47:34.972862 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:47:34.982968 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:34.983420 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:34.984225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:34.984667 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:35.001242 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for project c4e88457b140443093476f9b6d9bcff4. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:47:35.005631 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Getting quotas for user a892b2511463404c818c63e870a23389 and project c4e88457b140443093476f9b6d9bcff4. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:47:35.017864 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Going to run 1 instances... {{(pid=124465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:47:35.020143 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:47:35.066699 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1e9cd14b-f5e5-4344-adf8-82097fe0b5c2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.611698 Jul 12 13:47:35.067343 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 376/759] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:47:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:47:35.077414 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-25176ae4-f241-4e3e-a5dd-20eebe0d3a75 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:35.078151 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-25176ae4-f241-4e3e-a5dd-20eebe0d3a75 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:35.134019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-25176ae4-f241-4e3e-a5dd-20eebe0d3a75 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:35.140572 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-25176ae4-f241-4e3e-a5dd-20eebe0d3a75 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1241 microversion: 2.1 time: 0.067070 Jul 12 13:47:35.141295 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 384/760] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:35 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:35.367274 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b6fe9627-fe94-4aed-9eaf-49f4d5362cba tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:35.367899 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b6fe9627-fe94-4aed-9eaf-49f4d5362cba tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:35.375373 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6fe9627-fe94-4aed-9eaf-49f4d5362cba tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:35.375729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6fe9627-fe94-4aed-9eaf-49f4d5362cba tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:35.376495 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6fe9627-fe94-4aed-9eaf-49f4d5362cba tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:35.377192 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6fe9627-fe94-4aed-9eaf-49f4d5362cba tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:35.515663 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b6fe9627-fe94-4aed-9eaf-49f4d5362cba tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:35.524334 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b6fe9627-fe94-4aed-9eaf-49f4d5362cba tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1689 microversion: 2.1 time: 0.161466 Jul 12 13:47:35.525693 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 377/761] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:35 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:35.927194 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:35.927832 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:35.934860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:35.935312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:35.936081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:35.936522 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:35.967666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:35.968134 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:35.968583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lazy-loading 'fault' on Instance uuid 7471c9e4-567e-4cea-b61e-03e316aa82f5 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:36.009329 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a50af3c7d004e78a99875e1f36a9508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf5aa6b70414b8f81904a32fa4fa1ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:36.016772 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cde0a220-ff72-416a-b9f3-330f4f2f4eb9 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 200 len: 1308 microversion: 2.1 time: 0.093526 Jul 12 13:47:36.017330 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 385/762] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:35 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:36.158421 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3e79a7c8-189f-4246-a7ed-8c21cb2c5e0b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:36.159063 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3e79a7c8-189f-4246-a7ed-8c21cb2c5e0b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:36.165527 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3e79a7c8-189f-4246-a7ed-8c21cb2c5e0b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:36.166508 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3e79a7c8-189f-4246-a7ed-8c21cb2c5e0b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:36.167270 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3e79a7c8-189f-4246-a7ed-8c21cb2c5e0b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:36.167705 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3e79a7c8-189f-4246-a7ed-8c21cb2c5e0b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:36.232320 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3e79a7c8-189f-4246-a7ed-8c21cb2c5e0b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:36.240089 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3e79a7c8-189f-4246-a7ed-8c21cb2c5e0b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1245 microversion: 2.1 time: 0.085517 Jul 12 13:47:36.240652 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 378/763] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:36 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:36.542734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7fb4b493-ead0-4a4f-954e-1d9802a5fd6a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:36.543331 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7fb4b493-ead0-4a4f-954e-1d9802a5fd6a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:36.549650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7fb4b493-ead0-4a4f-954e-1d9802a5fd6a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:36.550135 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7fb4b493-ead0-4a4f-954e-1d9802a5fd6a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:36.550899 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7fb4b493-ead0-4a4f-954e-1d9802a5fd6a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:36.551331 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7fb4b493-ead0-4a4f-954e-1d9802a5fd6a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:36.683997 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7fb4b493-ead0-4a4f-954e-1d9802a5fd6a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:36.691608 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7fb4b493-ead0-4a4f-954e-1d9802a5fd6a tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1689 microversion: 2.1 time: 0.153403 Jul 12 13:47:36.692252 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 386/764] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:36 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:37.035132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6e7d559e-8800-4225-97ee-1b48299f01b3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:37.035673 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6e7d559e-8800-4225-97ee-1b48299f01b3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] [instance: 7471c9e4-567e-4cea-b61e-03e316aa82f5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:37.037605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:37.043825 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6e7d559e-8800-4225-97ee-1b48299f01b3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:37.044282 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6e7d559e-8800-4225-97ee-1b48299f01b3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:37.045059 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6e7d559e-8800-4225-97ee-1b48299f01b3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:37.045504 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6e7d559e-8800-4225-97ee-1b48299f01b3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:37.065397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-6e7d559e-8800-4225-97ee-1b48299f01b3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] HTTP exception thrown: Instance 7471c9e4-567e-4cea-b61e-03e316aa82f5 could not be found. Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6e7d559e-8800-4225-97ee-1b48299f01b3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Request method failure captured: Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 HTTP/1.1 Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXsIl0w3ke-KkBCSH0UZknNydPnb7swXI7-TAyy1zxp0HTZu8Cz0HOsdCr1f4jIzQOvecLe4c1dTWr5oach7svqibWE8O3TAdZfoy9RHPOe2FUwERW4YAE-IbDXxCPG0N0a6UJikmzKac722sUKaE_a3j6EDobyFmkPdMgfvEiTLITc Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: adf5aa6b70414b8f81904a32fa4fa1ab Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-VolumesSnapshotTestJSON-843177554 Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:47:37.067559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/adf5aa6b70414b8f81904a32fa4fa1ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/adf5aa6b70414b8f81904a32fa4fa1ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/adf5aa6b70414b8f81904a32fa4fa1ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_adf5aa6b70414b8f81904a32fa4fa1ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-VolumesSnapshotTestJSON-843177554 Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: adf5aa6b70414b8f81904a32fa4fa1ab Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-843177554 Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-VolumesSnapshotTestJSON-843177554-project Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 1a50af3c7d004e78a99875e1f36a9508 Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-VolumesSnapshotTestJSON-843177554-project Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance 7471c9e4-567e-4cea-b61e-03e316aa82f5 could not be found. Jul 12 13:47:37.068987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '7471c9e4-567e-4cea-b61e-03e316aa82f5'} Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7471c9e4-567e-4cea-b61e-03e316aa82f5 could not be found. Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:47:37.069821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7471c9e4-567e-4cea-b61e-03e316aa82f5 could not be found. Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7471c9e4-567e-4cea-b61e-03e316aa82f5 could not be found. Jul 12 13:47:37.071131 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:37.073373 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6e7d559e-8800-4225-97ee-1b48299f01b3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] Returning 404 to user: Instance 7471c9e4-567e-4cea-b61e-03e316aa82f5 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:47:37.073373 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6e7d559e-8800-4225-97ee-1b48299f01b3 tempest-VolumesSnapshotTestJSON-843177554 tempest-VolumesSnapshotTestJSON-843177554-project] 10.222.0.52 "GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5" status: 404 len: 111 microversion: 2.1 time: 0.038332 Jul 12 13:47:37.074306 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 379/765] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:37 2022] GET /compute/v2.1/servers/7471c9e4-567e-4cea-b61e-03e316aa82f5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:47:37.257486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-33e9bda0-588c-4b50-9077-5c53f51d46af tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:37.258681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-33e9bda0-588c-4b50-9077-5c53f51d46af tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:37.274296 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33e9bda0-588c-4b50-9077-5c53f51d46af tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:37.275504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33e9bda0-588c-4b50-9077-5c53f51d46af tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:37.276464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33e9bda0-588c-4b50-9077-5c53f51d46af tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:37.277063 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33e9bda0-588c-4b50-9077-5c53f51d46af tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:37.362507 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-33e9bda0-588c-4b50-9077-5c53f51d46af tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:37.377893 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-33e9bda0-588c-4b50-9077-5c53f51d46af tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1299 microversion: 2.1 time: 0.123528 Jul 12 13:47:37.378558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 387/766] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:37 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:37.708561 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e70708cd-cb2c-4e9a-9d94-cec24436e700 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:37.709167 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e70708cd-cb2c-4e9a-9d94-cec24436e700 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:37.715890 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e70708cd-cb2c-4e9a-9d94-cec24436e700 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:37.716339 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e70708cd-cb2c-4e9a-9d94-cec24436e700 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:37.717098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e70708cd-cb2c-4e9a-9d94-cec24436e700 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:37.718037 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e70708cd-cb2c-4e9a-9d94-cec24436e700 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:37.870539 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e70708cd-cb2c-4e9a-9d94-cec24436e700 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:37.878596 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e70708cd-cb2c-4e9a-9d94-cec24436e700 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1689 microversion: 2.1 time: 0.173894 Jul 12 13:47:37.879243 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 380/767] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:37 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:38.397570 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-19bbbd87-b108-45e2-9790-741eae435709 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:38.398412 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-19bbbd87-b108-45e2-9790-741eae435709 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:38.406385 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-19bbbd87-b108-45e2-9790-741eae435709 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:38.406941 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-19bbbd87-b108-45e2-9790-741eae435709 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:38.407816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-19bbbd87-b108-45e2-9790-741eae435709 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:38.408439 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-19bbbd87-b108-45e2-9790-741eae435709 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:38.498742 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-19bbbd87-b108-45e2-9790-741eae435709 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:38.507123 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-19bbbd87-b108-45e2-9790-741eae435709 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1299 microversion: 2.1 time: 0.115212 Jul 12 13:47:38.508396 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 388/768] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:38 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:38.583911 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-9d57569f-9293-4239-9374-2480ce7c22a5 req-5cca1939-1a4c-485f-a88e-1dca23b6e5ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42ee030-0bf1-402b-b7f4-9c9a33ac5aee", "name": "network-vif-deleted", "tag": "24703b74-9dc6-4b80-a6ab-4c0de6ab1334"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:38.594896 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-9d57569f-9293-4239-9374-2480ce7c22a5 req-5cca1939-1a4c-485f-a88e-1dca23b6e5ac service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:38.595559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-9d57569f-9293-4239-9374-2480ce7c22a5 req-5cca1939-1a4c-485f-a88e-1dca23b6e5ac service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:38.637844 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-9d57569f-9293-4239-9374-2480ce7c22a5 req-5cca1939-1a4c-485f-a88e-1dca23b6e5ac service nova] Creating event network-vif-deleted:24703b74-9dc6-4b80-a6ab-4c0de6ab1334 for instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee on hv-cinder-79797 Jul 12 13:47:38.664548 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-9d57569f-9293-4239-9374-2480ce7c22a5 req-5cca1939-1a4c-485f-a88e-1dca23b6e5ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070029 Jul 12 13:47:38.665864 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 381/769] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:38.895729 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:38.896350 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:38.903704 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:38.904064 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:38.904828 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:38.905261 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:38.940292 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:38.940748 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:38.941201 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lazy-loading 'fault' on Instance uuid f42ee030-0bf1-402b-b7f4-9c9a33ac5aee {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:39.015582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:39.024456 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-cbe24f26-fda6-4948-9726-4c0b46b177f8 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1335 microversion: 2.1 time: 0.132253 Jul 12 13:47:39.033559 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 389/770] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:38 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1335 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:39.527000 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7f406690-3e2a-4a94-8b16-91663f3d9d4d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:39.527699 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7f406690-3e2a-4a94-8b16-91663f3d9d4d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:39.535526 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7f406690-3e2a-4a94-8b16-91663f3d9d4d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:39.535973 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7f406690-3e2a-4a94-8b16-91663f3d9d4d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:39.536752 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7f406690-3e2a-4a94-8b16-91663f3d9d4d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:39.537192 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7f406690-3e2a-4a94-8b16-91663f3d9d4d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:39.681926 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7f406690-3e2a-4a94-8b16-91663f3d9d4d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:39.689704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7f406690-3e2a-4a94-8b16-91663f3d9d4d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1367 microversion: 2.1 time: 0.167751 Jul 12 13:47:39.690404 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 382/771] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:39 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:40.041210 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:40.041741 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:40.048219 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:40.048672 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:40.049427 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:40.049864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:40.079840 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:40.080298 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:40.080746 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lazy-loading 'fault' on Instance uuid f42ee030-0bf1-402b-b7f4-9c9a33ac5aee {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:40.124705 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:40.132441 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6ccd2a71-ff8f-43df-8d57-63007f90108b tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1335 microversion: 2.1 time: 0.095187 Jul 12 13:47:40.133000 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 390/772] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:40 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1335 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:40.688433 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-5fc730d0-af81-4aac-8643-c94aac8c3ce0 req-7b936cce-118f-4ab4-af05-6b21f129ffe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21b7c0d-991e-435a-a80a-0b5d2d7970da", "tag": "7458e1e4-bcf0-49b3-873b-4abca58b5d9d"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:40.696869 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-5fc730d0-af81-4aac-8643-c94aac8c3ce0 req-7b936cce-118f-4ab4-af05-6b21f129ffe5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:40.697321 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-5fc730d0-af81-4aac-8643-c94aac8c3ce0 req-7b936cce-118f-4ab4-af05-6b21f129ffe5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:40.705457 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fa388f62-c967-48eb-9212-5041761b4eba tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:40.706091 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fa388f62-c967-48eb-9212-5041761b4eba tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:40.707847 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-5fc730d0-af81-4aac-8643-c94aac8c3ce0 req-7b936cce-118f-4ab4-af05-6b21f129ffe5 service nova] Creating event network-changed:7458e1e4-bcf0-49b3-873b-4abca58b5d9d for instance e21b7c0d-991e-435a-a80a-0b5d2d7970da on hv-cinder-79797 Jul 12 13:47:40.712115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa388f62-c967-48eb-9212-5041761b4eba tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:40.712567 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-5fc730d0-af81-4aac-8643-c94aac8c3ce0 req-7b936cce-118f-4ab4-af05-6b21f129ffe5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027717 Jul 12 13:47:40.712712 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa388f62-c967-48eb-9212-5041761b4eba tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:40.713410 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 383/773] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:40.713532 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa388f62-c967-48eb-9212-5041761b4eba tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:40.713819 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fa388f62-c967-48eb-9212-5041761b4eba tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:40.838685 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fa388f62-c967-48eb-9212-5041761b4eba tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:40.846074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fa388f62-c967-48eb-9212-5041761b4eba tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1367 microversion: 2.1 time: 0.144324 Jul 12 13:47:40.846642 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 391/774] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:40 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:41.150926 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:41.151632 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:41.158458 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:41.158917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:41.159684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:41.160126 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:41.192102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:41.192553 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:41.193004 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lazy-loading 'fault' on Instance uuid f42ee030-0bf1-402b-b7f4-9c9a33ac5aee {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:41.233554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:41.240788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-cd2a218f-a637-4fb8-b9d6-5243a713c8d1 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 200 len: 1335 microversion: 2.1 time: 0.094603 Jul 12 13:47:41.241349 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 384/775] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:41 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 1335 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:41.862903 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7dfcabfd-5a8b-40e5-9ac6-7378a9ad2660 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:41.864205 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7dfcabfd-5a8b-40e5-9ac6-7378a9ad2660 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:41.871005 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7dfcabfd-5a8b-40e5-9ac6-7378a9ad2660 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:41.871465 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7dfcabfd-5a8b-40e5-9ac6-7378a9ad2660 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:41.872276 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7dfcabfd-5a8b-40e5-9ac6-7378a9ad2660 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:41.872719 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7dfcabfd-5a8b-40e5-9ac6-7378a9ad2660 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:42.082947 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7dfcabfd-5a8b-40e5-9ac6-7378a9ad2660 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:42.091211 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7dfcabfd-5a8b-40e5-9ac6-7378a9ad2660 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1367 microversion: 2.1 time: 0.232366 Jul 12 13:47:42.091795 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 392/776] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:41 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:42.257857 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-02956f06-8296-4b47-b739-c5e894d51af6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:42.258506 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-02956f06-8296-4b47-b739-c5e894d51af6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: f42ee030-0bf1-402b-b7f4-9c9a33ac5aee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:42.265205 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02956f06-8296-4b47-b739-c5e894d51af6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:42.265794 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02956f06-8296-4b47-b739-c5e894d51af6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:42.266624 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02956f06-8296-4b47-b739-c5e894d51af6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:42.267203 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-02956f06-8296-4b47-b739-c5e894d51af6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:42.280882 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-02956f06-8296-4b47-b739-c5e894d51af6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] HTTP exception thrown: Instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee could not be found. Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-02956f06-8296-4b47-b739-c5e894d51af6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Request method failure captured: Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee HTTP/1.1 Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXorjIDAbtDtJtOvfy_yv9nBXh4UfqRhYUnfhCPKZ1w7W9kDGIwjj1ekTdMPn8zN7wGJMTx5Sr-aikVIUV7yloW36HiYAaoGvrQUKUEGS8UYjts_zznUym4pBD6f0O81kujlfPaGrVaLWq2QpCY88duImZRzAd5rjBlsG-Ag3b_ZjJI Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 026f214eb4ee4a9c807b928710c93db5 Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:47:42.282554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 026f214eb4ee4a9c807b928710c93db5 Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-ServerRescueNegativeTestJSON-544559158-project Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 4a6b3bd40ad744908a05df7410cace52 Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-ServerRescueNegativeTestJSON-544559158-project Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee could not be found. Jul 12 13:47:42.284163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'f42ee030-0bf1-402b-b7f4-9c9a33ac5aee'} Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee could not be found. Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:47:42.284971 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee could not be found. Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee could not be found. Jul 12 13:47:42.286476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:42.287686 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-02956f06-8296-4b47-b739-c5e894d51af6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Returning 404 to user: Instance f42ee030-0bf1-402b-b7f4-9c9a33ac5aee could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:47:42.287686 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-02956f06-8296-4b47-b739-c5e894d51af6 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee" status: 404 len: 111 microversion: 2.1 time: 0.029927 Jul 12 13:47:42.287686 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 385/777] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:42 2022] GET /compute/v2.1/servers/f42ee030-0bf1-402b-b7f4-9c9a33ac5aee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:47:42.293214 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4fd60e10-50d2-4b55-9d1d-d2e8d80721ac tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '.version_select at 0x7f3a1670fa60>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:42.310773 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4fd60e10-50d2-4b55-9d1d-d2e8d80721ac tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796573232" status: 202 len: 0 microversion: 2.1 time: 0.021941 Jul 12 13:47:42.311339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 393/778] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jul 12 13:47:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796573232 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:47:43.107695 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e44943ab-aec3-4b90-b9f9-af2aa967576c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:43.108299 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e44943ab-aec3-4b90-b9f9-af2aa967576c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:43.114316 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e44943ab-aec3-4b90-b9f9-af2aa967576c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:43.114760 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e44943ab-aec3-4b90-b9f9-af2aa967576c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:43.115521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e44943ab-aec3-4b90-b9f9-af2aa967576c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:43.115951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e44943ab-aec3-4b90-b9f9-af2aa967576c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:43.265074 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e44943ab-aec3-4b90-b9f9-af2aa967576c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:43.272666 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e44943ab-aec3-4b90-b9f9-af2aa967576c tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1367 microversion: 2.1 time: 0.168711 Jul 12 13:47:43.273255 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 386/779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:43 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:44.290045 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0df7b0d1-445f-4421-8d4f-86b2c95e7b8b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:44.291175 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-0df7b0d1-445f-4421-8d4f-86b2c95e7b8b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:44.297165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0df7b0d1-445f-4421-8d4f-86b2c95e7b8b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:44.297615 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0df7b0d1-445f-4421-8d4f-86b2c95e7b8b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:44.298460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0df7b0d1-445f-4421-8d4f-86b2c95e7b8b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:44.298784 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-0df7b0d1-445f-4421-8d4f-86b2c95e7b8b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:44.434057 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-0df7b0d1-445f-4421-8d4f-86b2c95e7b8b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:44.443166 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0df7b0d1-445f-4421-8d4f-86b2c95e7b8b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1367 microversion: 2.1 time: 0.157370 Jul 12 13:47:44.443954 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 394/780] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:44 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:45.152190 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e24830e0-cb57-468f-aed6-7880bae8e619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:45.152705 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e24830e0-cb57-468f-aed6-7880bae8e619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:45.155176 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:45.155842 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=6 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:45.162256 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e24830e0-cb57-468f-aed6-7880bae8e619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:45.162712 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e24830e0-cb57-468f-aed6-7880bae8e619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:45.163485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e24830e0-cb57-468f-aed6-7880bae8e619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:45.163927 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e24830e0-cb57-468f-aed6-7880bae8e619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:45.191571 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e24830e0-cb57-468f-aed6-7880bae8e619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:47:45.268690 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e24830e0-cb57-468f-aed6-7880bae8e619 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 204 len: 0 microversion: 2.1 time: 0.121441 Jul 12 13:47:45.269454 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 387/781] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:47:45 2022] DELETE /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:47:45.277713 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ea0167aa-5737-4552-9bb0-679aebf8a623 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:45.278365 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ea0167aa-5737-4552-9bb0-679aebf8a623 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:45.280259 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:45.280911 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:45.287235 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ea0167aa-5737-4552-9bb0-679aebf8a623 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:45.287691 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ea0167aa-5737-4552-9bb0-679aebf8a623 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:45.288463 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ea0167aa-5737-4552-9bb0-679aebf8a623 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:45.288906 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ea0167aa-5737-4552-9bb0-679aebf8a623 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:45.420012 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ea0167aa-5737-4552-9bb0-679aebf8a623 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:45.427451 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ea0167aa-5737-4552-9bb0-679aebf8a623 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1507 microversion: 2.1 time: 0.153899 Jul 12 13:47:45.428021 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 395/782] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:45 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:45.460376 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-28dc851d-0512-4990-a1ca-40ec6f46dc8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:45.461132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-28dc851d-0512-4990-a1ca-40ec6f46dc8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:45.467551 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-28dc851d-0512-4990-a1ca-40ec6f46dc8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:45.467994 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-28dc851d-0512-4990-a1ca-40ec6f46dc8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:45.468746 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-28dc851d-0512-4990-a1ca-40ec6f46dc8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:45.469175 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-28dc851d-0512-4990-a1ca-40ec6f46dc8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:45.601150 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-28dc851d-0512-4990-a1ca-40ec6f46dc8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:45.611924 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-28dc851d-0512-4990-a1ca-40ec6f46dc8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1367 microversion: 2.1 time: 0.155617 Jul 12 13:47:45.612519 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 388/783] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:45 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:46.444466 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fb9d5908-5a97-4fac-95cb-e7a133249dfc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:46.445069 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fb9d5908-5a97-4fac-95cb-e7a133249dfc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:46.451992 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fb9d5908-5a97-4fac-95cb-e7a133249dfc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:46.452454 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fb9d5908-5a97-4fac-95cb-e7a133249dfc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:46.453219 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fb9d5908-5a97-4fac-95cb-e7a133249dfc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:46.453660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fb9d5908-5a97-4fac-95cb-e7a133249dfc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:46.583188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fb9d5908-5a97-4fac-95cb-e7a133249dfc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:46.590548 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fb9d5908-5a97-4fac-95cb-e7a133249dfc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1507 microversion: 2.1 time: 0.149943 Jul 12 13:47:46.591108 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 396/784] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:46 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:46.629244 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-29b1c342-6ae3-427a-b07a-f308121f54bf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:46.629868 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-29b1c342-6ae3-427a-b07a-f308121f54bf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:46.636393 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-29b1c342-6ae3-427a-b07a-f308121f54bf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:46.636844 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-29b1c342-6ae3-427a-b07a-f308121f54bf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:46.637610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-29b1c342-6ae3-427a-b07a-f308121f54bf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:46.638087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-29b1c342-6ae3-427a-b07a-f308121f54bf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:46.765932 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-29b1c342-6ae3-427a-b07a-f308121f54bf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:46.769401 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:46.774210 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-29b1c342-6ae3-427a-b07a-f308121f54bf tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1367 microversion: 2.1 time: 0.148977 Jul 12 13:47:46.774780 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 389/785] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:46 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:47.068798 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-14465f06-ce4b-4657-9d10-9b6de7709c91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:47.069296 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-14465f06-ce4b-4657-9d10-9b6de7709c91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:47.075312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14465f06-ce4b-4657-9d10-9b6de7709c91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:47.075764 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14465f06-ce4b-4657-9d10-9b6de7709c91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:47.076537 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14465f06-ce4b-4657-9d10-9b6de7709c91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:47.076975 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-14465f06-ce4b-4657-9d10-9b6de7709c91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:47.100713 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-14465f06-ce4b-4657-9d10-9b6de7709c91 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/ips" status: 200 len: 151 microversion: 2.20 time: 0.092044 Jul 12 13:47:47.101273 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 397/786] 10.222.0.52 () {60 vars in 1288 bytes} [Tue Jul 12 13:47:47 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 13:47:47.267502 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-bd01042c-641a-41ed-bcf0-5557eacac16d req-2dc1a478-2f3c-487d-a581-8a17f7cc950f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21b7c0d-991e-435a-a80a-0b5d2d7970da", "name": "network-vif-plugged", "status": "completed", "tag": "7458e1e4-bcf0-49b3-873b-4abca58b5d9d"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:47.277216 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-bd01042c-641a-41ed-bcf0-5557eacac16d req-2dc1a478-2f3c-487d-a581-8a17f7cc950f service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:47.277668 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-bd01042c-641a-41ed-bcf0-5557eacac16d req-2dc1a478-2f3c-487d-a581-8a17f7cc950f service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:47.288906 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-bd01042c-641a-41ed-bcf0-5557eacac16d req-2dc1a478-2f3c-487d-a581-8a17f7cc950f service nova] Creating event network-vif-plugged:7458e1e4-bcf0-49b3-873b-4abca58b5d9d for instance e21b7c0d-991e-435a-a80a-0b5d2d7970da on hv-cinder-79797 Jul 12 13:47:47.294456 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-bd01042c-641a-41ed-bcf0-5557eacac16d req-2dc1a478-2f3c-487d-a581-8a17f7cc950f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099575 Jul 12 13:47:47.295077 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 390/787] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:47.607742 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e7127a50-7000-47d8-a7c6-6280fc74992f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:47.608352 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e7127a50-7000-47d8-a7c6-6280fc74992f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:47.615265 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e7127a50-7000-47d8-a7c6-6280fc74992f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:47.615721 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e7127a50-7000-47d8-a7c6-6280fc74992f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:47.616487 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e7127a50-7000-47d8-a7c6-6280fc74992f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:47.616931 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e7127a50-7000-47d8-a7c6-6280fc74992f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:47.743920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e7127a50-7000-47d8-a7c6-6280fc74992f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:47.752103 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e7127a50-7000-47d8-a7c6-6280fc74992f tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1507 microversion: 2.1 time: 0.148043 Jul 12 13:47:47.752684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 398/788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:47 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:47.791852 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bf59d99b-32f1-4c70-8996-454f43908ea3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:47.792557 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bf59d99b-32f1-4c70-8996-454f43908ea3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:47.798704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf59d99b-32f1-4c70-8996-454f43908ea3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:47.799158 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf59d99b-32f1-4c70-8996-454f43908ea3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:47.799944 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf59d99b-32f1-4c70-8996-454f43908ea3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:47.800386 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf59d99b-32f1-4c70-8996-454f43908ea3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:47.930209 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bf59d99b-32f1-4c70-8996-454f43908ea3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:47.938083 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bf59d99b-32f1-4c70-8996-454f43908ea3 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1367 microversion: 2.1 time: 0.150835 Jul 12 13:47:47.938654 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 391/789] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:47 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:48.770779 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4df12c95-90fe-4f40-8dfa-19d97cc79dce tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:48.771329 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4df12c95-90fe-4f40-8dfa-19d97cc79dce tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:48.778181 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4df12c95-90fe-4f40-8dfa-19d97cc79dce tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:48.778640 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4df12c95-90fe-4f40-8dfa-19d97cc79dce tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:48.779414 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4df12c95-90fe-4f40-8dfa-19d97cc79dce tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:48.779853 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4df12c95-90fe-4f40-8dfa-19d97cc79dce tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:48.942507 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4df12c95-90fe-4f40-8dfa-19d97cc79dce tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:48.945953 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:48.951586 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4df12c95-90fe-4f40-8dfa-19d97cc79dce tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1507 microversion: 2.1 time: 0.184735 Jul 12 13:47:48.952254 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 399/790] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:48 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:48.954357 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-aa8431f4-0069-444e-a389-701fabaf2c15 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:48.955146 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-aa8431f4-0069-444e-a389-701fabaf2c15 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:48.961467 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-aa8431f4-0069-444e-a389-701fabaf2c15 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:48.962125 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-aa8431f4-0069-444e-a389-701fabaf2c15 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:48.962905 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-aa8431f4-0069-444e-a389-701fabaf2c15 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:48.963339 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-aa8431f4-0069-444e-a389-701fabaf2c15 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:49.096087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-aa8431f4-0069-444e-a389-701fabaf2c15 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:49.104976 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-aa8431f4-0069-444e-a389-701fabaf2c15 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1367 microversion: 2.1 time: 0.153962 Jul 12 13:47:49.105553 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 392/791] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:48 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:49.837934 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-7175a611-002c-4000-b693-b27f24656203 req-d8e6a377-349e-47b2-a8b4-f7d2ec608506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd43000-7184-403f-b685-55b46308109a", "name": "network-vif-deleted", "tag": "98f8baf2-5f9c-4979-978b-4e21a04f2087"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:49.846661 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-7175a611-002c-4000-b693-b27f24656203 req-d8e6a377-349e-47b2-a8b4-f7d2ec608506 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:49.847112 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-7175a611-002c-4000-b693-b27f24656203 req-d8e6a377-349e-47b2-a8b4-f7d2ec608506 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:49.866263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-7175a611-002c-4000-b693-b27f24656203 req-d8e6a377-349e-47b2-a8b4-f7d2ec608506 service nova] Creating event network-vif-deleted:98f8baf2-5f9c-4979-978b-4e21a04f2087 for instance 1cd43000-7184-403f-b685-55b46308109a on hv-cinder-79797 Jul 12 13:47:49.874239 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-7175a611-002c-4000-b693-b27f24656203 req-d8e6a377-349e-47b2-a8b4-f7d2ec608506 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039971 Jul 12 13:47:49.878934 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 400/792] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:49.968621 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:49.969903 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:49.977284 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:49.977742 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:49.978548 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:49.979218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:50.013218 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:50.013899 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:50.014530 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lazy-loading 'fault' on Instance uuid 1cd43000-7184-403f-b685-55b46308109a {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:50.066092 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:50.074423 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-25159feb-0eb5-4e5e-b047-77f3af3ff257 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 200 len: 1311 microversion: 2.1 time: 0.109854 Jul 12 13:47:50.075008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 393/793] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:49 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:50.123832 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6426b639-3a96-4f60-9303-8089af97f8c7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:50.124895 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6426b639-3a96-4f60-9303-8089af97f8c7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:50.133776 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6426b639-3a96-4f60-9303-8089af97f8c7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:50.134341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6426b639-3a96-4f60-9303-8089af97f8c7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:50.135392 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6426b639-3a96-4f60-9303-8089af97f8c7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:50.136830 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6426b639-3a96-4f60-9303-8089af97f8c7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:50.303366 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6426b639-3a96-4f60-9303-8089af97f8c7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:50.314504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6426b639-3a96-4f60-9303-8089af97f8c7 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1367 microversion: 2.1 time: 0.195689 Jul 12 13:47:50.315098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 401/794] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:50 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:50.485341 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-507f25bc-b530-434e-a909-8ecebc600908 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:50.485869 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-507f25bc-b530-434e-a909-8ecebc600908 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:50.492038 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-507f25bc-b530-434e-a909-8ecebc600908 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:50.492485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-507f25bc-b530-434e-a909-8ecebc600908 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:50.493247 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-507f25bc-b530-434e-a909-8ecebc600908 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:50.493689 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-507f25bc-b530-434e-a909-8ecebc600908 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:50.516240 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-507f25bc-b530-434e-a909-8ecebc600908 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lazy-loading 'flavor' on Instance uuid f1ae49d6-301e-4cf8-9037-3b59098c81c9 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:47:50.768947 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-507f25bc-b530-434e-a909-8ecebc600908 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "POST /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/action" status: 202 len: 0 microversion: 2.20 time: 0.287376 Jul 12 13:47:50.769505 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 394/795] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jul 12 13:47:50 2022] POST /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:47:50.778075 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c0107c6d-eb83-49c5-9198-72064e4233e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:50.778685 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c0107c6d-eb83-49c5-9198-72064e4233e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:50.784823 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0107c6d-eb83-49c5-9198-72064e4233e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:50.785271 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0107c6d-eb83-49c5-9198-72064e4233e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:50.786087 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0107c6d-eb83-49c5-9198-72064e4233e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:50.786528 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c0107c6d-eb83-49c5-9198-72064e4233e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:50.932165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c0107c6d-eb83-49c5-9198-72064e4233e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:50.940434 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c0107c6d-eb83-49c5-9198-72064e4233e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:50.941946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c0107c6d-eb83-49c5-9198-72064e4233e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:50.943121 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c0107c6d-eb83-49c5-9198-72064e4233e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.169466 Jul 12 13:47:50.943681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 402/796] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:47:50 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:47:51.092535 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-2b0f3b12-ad02-4db8-a7ae-f16813974d78 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:51.094436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-2b0f3b12-ad02-4db8-a7ae-f16813974d78 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 1cd43000-7184-403f-b685-55b46308109a] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:51.101757 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2b0f3b12-ad02-4db8-a7ae-f16813974d78 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.102268 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2b0f3b12-ad02-4db8-a7ae-f16813974d78 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.103042 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2b0f3b12-ad02-4db8-a7ae-f16813974d78 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.103485 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2b0f3b12-ad02-4db8-a7ae-f16813974d78 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.116602 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-2b0f3b12-ad02-4db8-a7ae-f16813974d78 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] HTTP exception thrown: Instance 1cd43000-7184-403f-b685-55b46308109a could not be found. Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-2b0f3b12-ad02-4db8-a7ae-f16813974d78 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Request method failure captured: Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a HTTP/1.1 Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXorjIDAbtDtJtOvfy_yv9nBXh4UfqRhYUnfhCPKZ1w7W9kDGIwjj1ekTdMPn8zN7wGJMTx5Sr-aikVIUV7yloW36HiYAaoGvrQUKUEGS8UYjts_zznUym4pBD6f0O81kujlfPaGrVaLWq2QpCY88duImZRzAd5rjBlsG-Ag3b_ZjJI Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 026f214eb4ee4a9c807b928710c93db5 Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:47:51.118272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 026f214eb4ee4a9c807b928710c93db5 Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-ServerRescueNegativeTestJSON-544559158-project Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 4a6b3bd40ad744908a05df7410cace52 Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-ServerRescueNegativeTestJSON-544559158-project Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance 1cd43000-7184-403f-b685-55b46308109a could not be found. Jul 12 13:47:51.119925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '1cd43000-7184-403f-b685-55b46308109a'} Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd43000-7184-403f-b685-55b46308109a could not be found. Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:47:51.120702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd43000-7184-403f-b685-55b46308109a could not be found. Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd43000-7184-403f-b685-55b46308109a could not be found. Jul 12 13:47:51.122241 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:51.123558 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-2b0f3b12-ad02-4db8-a7ae-f16813974d78 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Returning 404 to user: Instance 1cd43000-7184-403f-b685-55b46308109a could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:47:51.123558 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-2b0f3b12-ad02-4db8-a7ae-f16813974d78 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a" status: 404 len: 111 microversion: 2.1 time: 0.032551 Jul 12 13:47:51.123558 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 395/797] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:51 2022] GET /compute/v2.1/servers/1cd43000-7184-403f-b685-55b46308109a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:47:51.128579 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c9b12880-5b8c-4718-9114-f514734e5e73 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:51.129080 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c9b12880-5b8c-4718-9114-f514734e5e73 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:51.135740 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9b12880-5b8c-4718-9114-f514734e5e73 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.136200 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9b12880-5b8c-4718-9114-f514734e5e73 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.136967 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9b12880-5b8c-4718-9114-f514734e5e73 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.137415 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9b12880-5b8c-4718-9114-f514734e5e73 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.162195 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c9b12880-5b8c-4718-9114-f514734e5e73 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:47:51.235066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c9b12880-5b8c-4718-9114-f514734e5e73 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 204 len: 0 microversion: 2.1 time: 0.110351 Jul 12 13:47:51.235856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 403/798] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:47:51 2022] DELETE /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:47:51.245754 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7e050b08-c779-4cf8-abb4-15e504fdf7bc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:51.246430 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-7e050b08-c779-4cf8-abb4-15e504fdf7bc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:51.253189 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e050b08-c779-4cf8-abb4-15e504fdf7bc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.253634 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e050b08-c779-4cf8-abb4-15e504fdf7bc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.254434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e050b08-c779-4cf8-abb4-15e504fdf7bc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.254870 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-7e050b08-c779-4cf8-abb4-15e504fdf7bc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.332740 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-41b1ef45-a64e-43c4-a488-a970aa6c7c3b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:51.333434 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-41b1ef45-a64e-43c4-a488-a970aa6c7c3b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:51.339747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41b1ef45-a64e-43c4-a488-a970aa6c7c3b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.340277 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41b1ef45-a64e-43c4-a488-a970aa6c7c3b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.341122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41b1ef45-a64e-43c4-a488-a970aa6c7c3b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.341765 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-41b1ef45-a64e-43c4-a488-a970aa6c7c3b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.391327 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-7e050b08-c779-4cf8-abb4-15e504fdf7bc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:51.400135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7e050b08-c779-4cf8-abb4-15e504fdf7bc tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.159876 Jul 12 13:47:51.400704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 396/799] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:51 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:51.486248 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-41b1ef45-a64e-43c4-a488-a970aa6c7c3b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:51.493628 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-41b1ef45-a64e-43c4-a488-a970aa6c7c3b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1557 microversion: 2.1 time: 0.165276 Jul 12 13:47:51.494244 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 404/800] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:51 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:47:51.511348 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e4718669-3d64-45e4-8579-25673b4144ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:51.511886 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e4718669-3d64-45e4-8579-25673b4144ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:51.518253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e4718669-3d64-45e4-8579-25673b4144ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.518710 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e4718669-3d64-45e4-8579-25673b4144ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.519474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e4718669-3d64-45e4-8579-25673b4144ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.519914 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e4718669-3d64-45e4-8579-25673b4144ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.597871 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e4718669-3d64-45e4-8579-25673b4144ca tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090584 Jul 12 13:47:51.598801 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 397/801] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Jul 12 13:47:51 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:51.961931 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1c03f64f-760b-4687-8c47-c4d23eaacb76 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:51.962681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1c03f64f-760b-4687-8c47-c4d23eaacb76 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:51.969283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c03f64f-760b-4687-8c47-c4d23eaacb76 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.969810 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c03f64f-760b-4687-8c47-c4d23eaacb76 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:51.970675 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c03f64f-760b-4687-8c47-c4d23eaacb76 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:51.971181 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1c03f64f-760b-4687-8c47-c4d23eaacb76 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:52.115177 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1c03f64f-760b-4687-8c47-c4d23eaacb76 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:52.123313 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1c03f64f-760b-4687-8c47-c4d23eaacb76 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:52.125168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1c03f64f-760b-4687-8c47-c4d23eaacb76 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:52.126382 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1c03f64f-760b-4687-8c47-c4d23eaacb76 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.168427 Jul 12 13:47:52.127212 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 405/802] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:47:51 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:47:52.417915 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-82844e33-c73c-400b-bbd8-f9fcd0d48c63 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:52.418557 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-82844e33-c73c-400b-bbd8-f9fcd0d48c63 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:52.424836 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82844e33-c73c-400b-bbd8-f9fcd0d48c63 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:52.425282 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82844e33-c73c-400b-bbd8-f9fcd0d48c63 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:52.426140 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82844e33-c73c-400b-bbd8-f9fcd0d48c63 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:52.426580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82844e33-c73c-400b-bbd8-f9fcd0d48c63 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:52.748365 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-82844e33-c73c-400b-bbd8-f9fcd0d48c63 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:52.757809 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-82844e33-c73c-400b-bbd8-f9fcd0d48c63 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.344730 Jul 12 13:47:52.758670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 398/803] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:52 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:52.894933 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-3109ba9b-f7e0-4adc-9486-4bd2638def42 req-6efcb8cb-326f-4eac-a5d6-ce1d177bd3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e21b7c0d-991e-435a-a80a-0b5d2d7970da", "tag": "7458e1e4-bcf0-49b3-873b-4abca58b5d9d"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:52.903017 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-3109ba9b-f7e0-4adc-9486-4bd2638def42 req-6efcb8cb-326f-4eac-a5d6-ce1d177bd3ed service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:52.903463 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-3109ba9b-f7e0-4adc-9486-4bd2638def42 req-6efcb8cb-326f-4eac-a5d6-ce1d177bd3ed service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:52.914456 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-3109ba9b-f7e0-4adc-9486-4bd2638def42 req-6efcb8cb-326f-4eac-a5d6-ce1d177bd3ed service nova] Creating event network-changed:7458e1e4-bcf0-49b3-873b-4abca58b5d9d for instance e21b7c0d-991e-435a-a80a-0b5d2d7970da on hv-cinder-79797 Jul 12 13:47:52.919601 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-3109ba9b-f7e0-4adc-9486-4bd2638def42 req-6efcb8cb-326f-4eac-a5d6-ce1d177bd3ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082444 Jul 12 13:47:52.920197 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 406/804] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:47:53.144885 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-630cb352-821f-4fc3-9554-2fdf0b8f5f1a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:53.145493 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-630cb352-821f-4fc3-9554-2fdf0b8f5f1a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:53.151469 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-630cb352-821f-4fc3-9554-2fdf0b8f5f1a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:53.151913 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-630cb352-821f-4fc3-9554-2fdf0b8f5f1a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:53.152675 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-630cb352-821f-4fc3-9554-2fdf0b8f5f1a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:53.153112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-630cb352-821f-4fc3-9554-2fdf0b8f5f1a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:53.441627 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-630cb352-821f-4fc3-9554-2fdf0b8f5f1a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:53.451060 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-630cb352-821f-4fc3-9554-2fdf0b8f5f1a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:53.452567 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-630cb352-821f-4fc3-9554-2fdf0b8f5f1a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:53.453730 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-630cb352-821f-4fc3-9554-2fdf0b8f5f1a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.313080 Jul 12 13:47:53.454311 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 399/805] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:47:53 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:47:53.777093 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3ca7d717-a57a-4c67-ac08-741d6db027cd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:53.778578 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3ca7d717-a57a-4c67-ac08-741d6db027cd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:53.785937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ca7d717-a57a-4c67-ac08-741d6db027cd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:53.786430 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ca7d717-a57a-4c67-ac08-741d6db027cd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:53.787203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ca7d717-a57a-4c67-ac08-741d6db027cd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:53.787635 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3ca7d717-a57a-4c67-ac08-741d6db027cd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:54.355297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3ca7d717-a57a-4c67-ac08-741d6db027cd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a6b3bd40ad744908a05df7410cace52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '026f214eb4ee4a9c807b928710c93db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:54.362715 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3ca7d717-a57a-4c67-ac08-741d6db027cd tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 200 len: 1523 microversion: 2.1 time: 0.590713 Jul 12 13:47:54.363478 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 407/806] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:53 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 1523 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:47:54.471298 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-77530955-5af9-418e-be60-ebdbbd7f7352 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:54.472011 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-77530955-5af9-418e-be60-ebdbbd7f7352 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:54.478997 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-77530955-5af9-418e-be60-ebdbbd7f7352 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:54.479753 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-77530955-5af9-418e-be60-ebdbbd7f7352 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:54.480992 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-77530955-5af9-418e-be60-ebdbbd7f7352 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:54.481682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-77530955-5af9-418e-be60-ebdbbd7f7352 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:54.625086 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-77530955-5af9-418e-be60-ebdbbd7f7352 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:54.636628 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-ede65802-4ed5-455a-9113-2dcafb98a519 req-9b3ab7fa-1890-4bc8-bc7f-85013b0566ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bb10a9b-adfe-4578-82cc-c87fb34cbc33", "name": "network-vif-deleted", "tag": "21198481-b443-4a4b-aef1-450d509835e7"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:47:54.636781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-77530955-5af9-418e-be60-ebdbbd7f7352 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:54.638665 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-77530955-5af9-418e-be60-ebdbbd7f7352 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:54.639970 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-77530955-5af9-418e-be60-ebdbbd7f7352 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.172471 Jul 12 13:47:54.640619 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 400/807] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:47:54 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:47:54.645045 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ede65802-4ed5-455a-9113-2dcafb98a519 req-9b3ab7fa-1890-4bc8-bc7f-85013b0566ca service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:54.645487 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-ede65802-4ed5-455a-9113-2dcafb98a519 req-9b3ab7fa-1890-4bc8-bc7f-85013b0566ca service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:54.656621 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-ede65802-4ed5-455a-9113-2dcafb98a519 req-9b3ab7fa-1890-4bc8-bc7f-85013b0566ca service nova] Creating event network-vif-deleted:21198481-b443-4a4b-aef1-450d509835e7 for instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 on hv-cinder-79797 Jul 12 13:47:54.662350 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-ede65802-4ed5-455a-9113-2dcafb98a519 req-9b3ab7fa-1890-4bc8-bc7f-85013b0566ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030563 Jul 12 13:47:54.665704 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 408/808] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:47:55.380316 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4793fdd6-e2f2-4c38-8668-e076f4e9a5c3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:55.380930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4793fdd6-e2f2-4c38-8668-e076f4e9a5c3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] [instance: 4bb10a9b-adfe-4578-82cc-c87fb34cbc33] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:55.387284 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4793fdd6-e2f2-4c38-8668-e076f4e9a5c3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:55.387742 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4793fdd6-e2f2-4c38-8668-e076f4e9a5c3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:55.388507 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4793fdd6-e2f2-4c38-8668-e076f4e9a5c3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:55.388949 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4793fdd6-e2f2-4c38-8668-e076f4e9a5c3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:55.402754 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-4793fdd6-e2f2-4c38-8668-e076f4e9a5c3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] HTTP exception thrown: Instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 could not be found. Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4793fdd6-e2f2-4c38-8668-e076f4e9a5c3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Request method failure captured: Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 HTTP/1.1 Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXorjIDAbtDtJtOvfy_yv9nBXh4UfqRhYUnfhCPKZ1w7W9kDGIwjj1ekTdMPn8zN7wGJMTx5Sr-aikVIUV7yloW36HiYAaoGvrQUKUEGS8UYjts_zznUym4pBD6f0O81kujlfPaGrVaLWq2QpCY88duImZRzAd5rjBlsG-Ag3b_ZjJI Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 026f214eb4ee4a9c807b928710c93db5 Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:47:55.404275 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_026f214eb4ee4a9c807b928710c93db5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 026f214eb4ee4a9c807b928710c93db5 Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-544559158 Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-ServerRescueNegativeTestJSON-544559158-project Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 4a6b3bd40ad744908a05df7410cace52 Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-ServerRescueNegativeTestJSON-544559158-project Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 could not be found. Jul 12 13:47:55.405823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '4bb10a9b-adfe-4578-82cc-c87fb34cbc33'} Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 could not be found. Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:47:55.406722 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 could not be found. Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 could not be found. Jul 12 13:47:55.408118 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:47:55.409495 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4793fdd6-e2f2-4c38-8668-e076f4e9a5c3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] Returning 404 to user: Instance 4bb10a9b-adfe-4578-82cc-c87fb34cbc33 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:47:55.409495 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4793fdd6-e2f2-4c38-8668-e076f4e9a5c3 tempest-ServerRescueNegativeTestJSON-544559158 tempest-ServerRescueNegativeTestJSON-544559158-project] 10.222.0.52 "GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33" status: 404 len: 111 microversion: 2.1 time: 0.029490 Jul 12 13:47:55.409495 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 401/809] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:47:55 2022] GET /compute/v2.1/servers/4bb10a9b-adfe-4578-82cc-c87fb34cbc33 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:47:55.659553 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-17454e1c-9ec6-4cb1-ac24-09a472beabe7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:55.660166 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-17454e1c-9ec6-4cb1-ac24-09a472beabe7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:55.666969 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17454e1c-9ec6-4cb1-ac24-09a472beabe7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:55.667425 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17454e1c-9ec6-4cb1-ac24-09a472beabe7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:55.668204 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17454e1c-9ec6-4cb1-ac24-09a472beabe7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:55.668674 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-17454e1c-9ec6-4cb1-ac24-09a472beabe7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:55.952999 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-17454e1c-9ec6-4cb1-ac24-09a472beabe7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:55.961534 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-17454e1c-9ec6-4cb1-ac24-09a472beabe7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:55.963137 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-17454e1c-9ec6-4cb1-ac24-09a472beabe7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:55.965441 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-17454e1c-9ec6-4cb1-ac24-09a472beabe7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.310980 Jul 12 13:47:55.976890 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 409/810] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:47:55 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:47:56.984779 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-580983cf-a491-4199-ad83-e43eff83851e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:56.985677 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-580983cf-a491-4199-ad83-e43eff83851e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:57.012066 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-580983cf-a491-4199-ad83-e43eff83851e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:57.016196 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-580983cf-a491-4199-ad83-e43eff83851e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:57.017201 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-580983cf-a491-4199-ad83-e43eff83851e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:57.020702 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-580983cf-a491-4199-ad83-e43eff83851e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:57.172824 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-580983cf-a491-4199-ad83-e43eff83851e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:57.182863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-580983cf-a491-4199-ad83-e43eff83851e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:57.184768 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-580983cf-a491-4199-ad83-e43eff83851e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:57.186087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-580983cf-a491-4199-ad83-e43eff83851e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.205819 Jul 12 13:47:57.196526 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 402/811] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:47:56 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:47:58.204344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4943a639-f685-42de-abe9-b4e4a906f998 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:58.204951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4943a639-f685-42de-abe9-b4e4a906f998 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:58.215527 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4943a639-f685-42de-abe9-b4e4a906f998 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:58.215991 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4943a639-f685-42de-abe9-b4e4a906f998 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:58.216786 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4943a639-f685-42de-abe9-b4e4a906f998 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:58.217229 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4943a639-f685-42de-abe9-b4e4a906f998 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:58.664196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4943a639-f685-42de-abe9-b4e4a906f998 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:58.674521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4943a639-f685-42de-abe9-b4e4a906f998 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:58.676439 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4943a639-f685-42de-abe9-b4e4a906f998 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:58.677845 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4943a639-f685-42de-abe9-b4e4a906f998 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.477413 Jul 12 13:47:58.678619 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 410/812] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:47:58 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:47:59.696455 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b51dccbe-66c2-4ff4-9b33-c599708e7e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:47:59.697060 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b51dccbe-66c2-4ff4-9b33-c599708e7e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:47:59.703698 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b51dccbe-66c2-4ff4-9b33-c599708e7e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:59.704421 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b51dccbe-66c2-4ff4-9b33-c599708e7e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:59.705194 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b51dccbe-66c2-4ff4-9b33-c599708e7e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:47:59.705770 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b51dccbe-66c2-4ff4-9b33-c599708e7e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:47:59.857085 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b51dccbe-66c2-4ff4-9b33-c599708e7e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:59.867769 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b51dccbe-66c2-4ff4-9b33-c599708e7e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:59.869622 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b51dccbe-66c2-4ff4-9b33-c599708e7e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:47:59.871475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b51dccbe-66c2-4ff4-9b33-c599708e7e92 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.178865 Jul 12 13:47:59.872105 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 403/813] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:47:59 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:00.889810 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7993e312-ef06-424d-98e3-c61820497ef8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:00.890512 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7993e312-ef06-424d-98e3-c61820497ef8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:00.897121 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7993e312-ef06-424d-98e3-c61820497ef8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:00.897598 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7993e312-ef06-424d-98e3-c61820497ef8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:00.898432 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7993e312-ef06-424d-98e3-c61820497ef8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:00.898867 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7993e312-ef06-424d-98e3-c61820497ef8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:01.093044 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7993e312-ef06-424d-98e3-c61820497ef8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:01.104302 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7993e312-ef06-424d-98e3-c61820497ef8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:01.106968 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7993e312-ef06-424d-98e3-c61820497ef8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:01.109687 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7993e312-ef06-424d-98e3-c61820497ef8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.223424 Jul 12 13:48:01.111191 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 411/814] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:00 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:02.128589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5c14029c-76fb-4212-b909-e8b7e1171c5d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:02.129223 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5c14029c-76fb-4212-b909-e8b7e1171c5d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:02.136447 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5c14029c-76fb-4212-b909-e8b7e1171c5d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:02.137363 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5c14029c-76fb-4212-b909-e8b7e1171c5d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:02.137822 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5c14029c-76fb-4212-b909-e8b7e1171c5d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:02.138359 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5c14029c-76fb-4212-b909-e8b7e1171c5d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:02.273920 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5c14029c-76fb-4212-b909-e8b7e1171c5d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:02.283141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5c14029c-76fb-4212-b909-e8b7e1171c5d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:02.284661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5c14029c-76fb-4212-b909-e8b7e1171c5d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:02.285857 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5c14029c-76fb-4212-b909-e8b7e1171c5d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.161462 Jul 12 13:48:02.286688 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 404/815] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:02 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:03.306931 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ce06ea02-519a-4fa0-bae3-7cc916de10b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:03.308653 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ce06ea02-519a-4fa0-bae3-7cc916de10b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:03.315964 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ce06ea02-519a-4fa0-bae3-7cc916de10b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:03.316500 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ce06ea02-519a-4fa0-bae3-7cc916de10b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:03.317376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ce06ea02-519a-4fa0-bae3-7cc916de10b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:03.317882 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ce06ea02-519a-4fa0-bae3-7cc916de10b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:03.451136 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ce06ea02-519a-4fa0-bae3-7cc916de10b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:03.458921 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ce06ea02-519a-4fa0-bae3-7cc916de10b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:03.460435 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ce06ea02-519a-4fa0-bae3-7cc916de10b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:03.461594 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ce06ea02-519a-4fa0-bae3-7cc916de10b2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.158592 Jul 12 13:48:03.462180 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 412/816] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:03 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:04.480433 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5a820c54-1175-45e0-951b-5c74a18edfe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:04.481675 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5a820c54-1175-45e0-951b-5c74a18edfe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:04.488253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5a820c54-1175-45e0-951b-5c74a18edfe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:04.488674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5a820c54-1175-45e0-951b-5c74a18edfe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:04.489436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5a820c54-1175-45e0-951b-5c74a18edfe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:04.489984 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5a820c54-1175-45e0-951b-5c74a18edfe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:04.625751 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5a820c54-1175-45e0-951b-5c74a18edfe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:04.634352 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5a820c54-1175-45e0-951b-5c74a18edfe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:04.635886 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5a820c54-1175-45e0-951b-5c74a18edfe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:04.637102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5a820c54-1175-45e0-951b-5c74a18edfe3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.161066 Jul 12 13:48:04.637684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 405/817] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:04 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:05.655760 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bbffe872-6ff8-4933-8a06-7982c9db4866 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:05.656379 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bbffe872-6ff8-4933-8a06-7982c9db4866 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:05.663270 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbffe872-6ff8-4933-8a06-7982c9db4866 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:05.663729 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbffe872-6ff8-4933-8a06-7982c9db4866 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:05.664507 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbffe872-6ff8-4933-8a06-7982c9db4866 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:05.664951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bbffe872-6ff8-4933-8a06-7982c9db4866 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:05.799520 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bbffe872-6ff8-4933-8a06-7982c9db4866 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:05.807648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bbffe872-6ff8-4933-8a06-7982c9db4866 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:05.809174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bbffe872-6ff8-4933-8a06-7982c9db4866 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:05.810412 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bbffe872-6ff8-4933-8a06-7982c9db4866 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.158471 Jul 12 13:48:05.811100 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 413/818] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:05 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:06.827829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-98262ed6-6d86-4b0a-b77f-b554c58c6f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:06.828582 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-98262ed6-6d86-4b0a-b77f-b554c58c6f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:06.835438 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-98262ed6-6d86-4b0a-b77f-b554c58c6f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:06.835894 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-98262ed6-6d86-4b0a-b77f-b554c58c6f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:06.836661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-98262ed6-6d86-4b0a-b77f-b554c58c6f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:06.837097 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-98262ed6-6d86-4b0a-b77f-b554c58c6f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:06.856370 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:06.975364 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-98262ed6-6d86-4b0a-b77f-b554c58c6f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:06.986483 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-98262ed6-6d86-4b0a-b77f-b554c58c6f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:06.988523 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-98262ed6-6d86-4b0a-b77f-b554c58c6f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:06.989830 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-98262ed6-6d86-4b0a-b77f-b554c58c6f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1742 microversion: 2.20 time: 0.165793 Jul 12 13:48:06.990451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 406/819] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:06 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:07.228258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ed5e7e45-cfa0-45ad-aa93-0822ef4ea7e2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:07.228789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ed5e7e45-cfa0-45ad-aa93-0822ef4ea7e2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:07.235758 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ed5e7e45-cfa0-45ad-aa93-0822ef4ea7e2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:07.236204 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ed5e7e45-cfa0-45ad-aa93-0822ef4ea7e2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:07.236961 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ed5e7e45-cfa0-45ad-aa93-0822ef4ea7e2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:07.237397 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ed5e7e45-cfa0-45ad-aa93-0822ef4ea7e2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:07.260351 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ed5e7e45-cfa0-45ad-aa93-0822ef4ea7e2 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/ips" status: 200 len: 145 microversion: 2.1 time: 0.035932 Jul 12 13:48:07.261001 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 414/820] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jul 12 13:48:07 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:08.009885 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c7652dfb-222e-45d6-8dec-1bb93d0a9adb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:08.010527 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c7652dfb-222e-45d6-8dec-1bb93d0a9adb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:08.013447 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:08.019655 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c7652dfb-222e-45d6-8dec-1bb93d0a9adb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:08.020113 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c7652dfb-222e-45d6-8dec-1bb93d0a9adb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:08.020882 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c7652dfb-222e-45d6-8dec-1bb93d0a9adb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:08.021326 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c7652dfb-222e-45d6-8dec-1bb93d0a9adb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:08.152356 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c7652dfb-222e-45d6-8dec-1bb93d0a9adb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:08.160745 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c7652dfb-222e-45d6-8dec-1bb93d0a9adb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:08.162417 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c7652dfb-222e-45d6-8dec-1bb93d0a9adb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:08.163717 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c7652dfb-222e-45d6-8dec-1bb93d0a9adb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1742 microversion: 2.20 time: 0.157810 Jul 12 13:48:08.164270 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 407/821] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:08 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:09.183866 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c5f1bb92-b831-4b1f-a5f5-7ccfcdd8d283 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:09.184479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c5f1bb92-b831-4b1f-a5f5-7ccfcdd8d283 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:09.191120 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5f1bb92-b831-4b1f-a5f5-7ccfcdd8d283 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:09.191577 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5f1bb92-b831-4b1f-a5f5-7ccfcdd8d283 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:09.192349 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5f1bb92-b831-4b1f-a5f5-7ccfcdd8d283 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:09.192794 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c5f1bb92-b831-4b1f-a5f5-7ccfcdd8d283 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:09.326318 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c5f1bb92-b831-4b1f-a5f5-7ccfcdd8d283 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:09.334933 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c5f1bb92-b831-4b1f-a5f5-7ccfcdd8d283 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:09.336840 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c5f1bb92-b831-4b1f-a5f5-7ccfcdd8d283 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:09.338257 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c5f1bb92-b831-4b1f-a5f5-7ccfcdd8d283 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1742 microversion: 2.20 time: 0.158267 Jul 12 13:48:09.339983 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 415/822] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:09 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:09.359619 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0e519ac3-ea7f-46b5-80f3-892d00ae492d tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:09.360630 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0e519ac3-ea7f-46b5-80f3-892d00ae492d tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:09.367089 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0e519ac3-ea7f-46b5-80f3-892d00ae492d tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:09.367541 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0e519ac3-ea7f-46b5-80f3-892d00ae492d tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:09.368313 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0e519ac3-ea7f-46b5-80f3-892d00ae492d tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:09.368754 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0e519ac3-ea7f-46b5-80f3-892d00ae492d tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:09.451016 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0e519ac3-ea7f-46b5-80f3-892d00ae492d tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "POST /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1/action" status: 200 len: 14 microversion: 2.1 time: 0.095891 Jul 12 13:48:09.452351 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 408/823] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:48:09 2022] POST /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:48:10.296836 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3e91ecf9-06a9-4f64-ac98-d5f8ac4b051a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:10.297327 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3e91ecf9-06a9-4f64-ac98-d5f8ac4b051a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:10.299865 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-ed27f564-aff1-4f57-af49-97cc415f22d2 req-c658ce49-d9ea-4c3a-bf4e-62161d521f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c496f49-2bd0-4b55-bca1-6402b331e1a1", "tag": "dd8d0273-59e6-4628-b80c-fb8d75a315d0"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:10.309890 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3e91ecf9-06a9-4f64-ac98-d5f8ac4b051a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:10.310648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3e91ecf9-06a9-4f64-ac98-d5f8ac4b051a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:10.310806 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-ed27f564-aff1-4f57-af49-97cc415f22d2 req-c658ce49-d9ea-4c3a-bf4e-62161d521f18 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:10.311503 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-ed27f564-aff1-4f57-af49-97cc415f22d2 req-c658ce49-d9ea-4c3a-bf4e-62161d521f18 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:10.311901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3e91ecf9-06a9-4f64-ac98-d5f8ac4b051a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:10.312409 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3e91ecf9-06a9-4f64-ac98-d5f8ac4b051a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:10.332657 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-ed27f564-aff1-4f57-af49-97cc415f22d2 req-c658ce49-d9ea-4c3a-bf4e-62161d521f18 service nova] Creating event network-changed:dd8d0273-59e6-4628-b80c-fb8d75a315d0 for instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 on hv-cinder-79797 Jul 12 13:48:10.340319 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-ed27f564-aff1-4f57-af49-97cc415f22d2 req-c658ce49-d9ea-4c3a-bf4e-62161d521f18 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043203 Jul 12 13:48:10.340319 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 409/824] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:10.348954 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3e91ecf9-06a9-4f64-ac98-d5f8ac4b051a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:48:10.359172 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-66df2959-20b9-4341-add7-8885b1e774bc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:10.359875 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-66df2959-20b9-4341-add7-8885b1e774bc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:10.373024 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66df2959-20b9-4341-add7-8885b1e774bc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:10.373523 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66df2959-20b9-4341-add7-8885b1e774bc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:10.375303 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66df2959-20b9-4341-add7-8885b1e774bc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:10.375303 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66df2959-20b9-4341-add7-8885b1e774bc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:10.388335 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:10.540085 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3e91ecf9-06a9-4f64-ac98-d5f8ac4b051a tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 204 len: 0 microversion: 2.1 time: 0.246736 Jul 12 13:48:10.541007 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 416/825] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:48:10 2022] DELETE /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:48:10.549856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ad32b95e-f84a-4f8c-bd65-6625e580d926 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:10.550673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ad32b95e-f84a-4f8c-bd65-6625e580d926 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:10.560194 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad32b95e-f84a-4f8c-bd65-6625e580d926 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:10.560755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad32b95e-f84a-4f8c-bd65-6625e580d926 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:10.561594 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad32b95e-f84a-4f8c-bd65-6625e580d926 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:10.562083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad32b95e-f84a-4f8c-bd65-6625e580d926 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:10.654502 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-66df2959-20b9-4341-add7-8885b1e774bc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:10.665186 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-66df2959-20b9-4341-add7-8885b1e774bc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:10.668701 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-66df2959-20b9-4341-add7-8885b1e774bc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:10.679619 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-66df2959-20b9-4341-add7-8885b1e774bc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1742 microversion: 2.20 time: 0.323502 Jul 12 13:48:10.682060 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 410/826] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:10 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1742 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:10.722267 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b395f024-b95e-4f4e-8bad-3de56f51c646 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1d0d75c-b4aa-4364-9a87-7cd508ad9a39"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:10.723429 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b395f024-b95e-4f4e-8bad-3de56f51c646 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:10.733788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b395f024-b95e-4f4e-8bad-3de56f51c646 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:10.734386 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b395f024-b95e-4f4e-8bad-3de56f51c646 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:10.742426 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b395f024-b95e-4f4e-8bad-3de56f51c646 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:10.742932 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b395f024-b95e-4f4e-8bad-3de56f51c646 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:10.805050 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ad32b95e-f84a-4f8c-bd65-6625e580d926 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:10.815397 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ad32b95e-f84a-4f8c-bd65-6625e580d926 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1574 microversion: 2.1 time: 0.268971 Jul 12 13:48:10.817156 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 417/827] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:10 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1574 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:11.094293 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-cf8c6760-fa0f-4b79-9ca9-99dacd5d2cec req-de091470-62a3-4635-b19c-3a1117d55992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ae49d6-301e-4cf8-9037-3b59098c81c9", "name": "network-vif-plugged", "status": "completed", "tag": "f5b2cadb-da8b-47ae-8893-71246ab085ad"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:11.103362 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-cf8c6760-fa0f-4b79-9ca9-99dacd5d2cec req-de091470-62a3-4635-b19c-3a1117d55992 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:11.103889 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-cf8c6760-fa0f-4b79-9ca9-99dacd5d2cec req-de091470-62a3-4635-b19c-3a1117d55992 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:11.115473 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-cf8c6760-fa0f-4b79-9ca9-99dacd5d2cec req-de091470-62a3-4635-b19c-3a1117d55992 service nova] Creating event network-vif-plugged:f5b2cadb-da8b-47ae-8893-71246ab085ad for instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 on hv-cinder-79797 Jul 12 13:48:11.120787 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-cf8c6760-fa0f-4b79-9ca9-99dacd5d2cec req-de091470-62a3-4635-b19c-3a1117d55992 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029813 Jul 12 13:48:11.121511 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 418/828] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:48:11.710389 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b14eb785-b945-4e64-b9a5-4504b8c712de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:11.711165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b14eb785-b945-4e64-b9a5-4504b8c712de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:11.718558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b14eb785-b945-4e64-b9a5-4504b8c712de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:11.719026 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b14eb785-b945-4e64-b9a5-4504b8c712de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:11.719789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b14eb785-b945-4e64-b9a5-4504b8c712de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:11.720231 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b14eb785-b945-4e64-b9a5-4504b8c712de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:11.866694 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b14eb785-b945-4e64-b9a5-4504b8c712de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:11.875037 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b14eb785-b945-4e64-b9a5-4504b8c712de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:11.876683 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b14eb785-b945-4e64-b9a5-4504b8c712de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:11.878158 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b14eb785-b945-4e64-b9a5-4504b8c712de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1742 microversion: 2.20 time: 0.173550 Jul 12 13:48:11.878940 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 419/829] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:11 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:11.883913 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6b87cc9d-09a0-4a3c-b897-eed5811755fa tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:11.884592 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6b87cc9d-09a0-4a3c-b897-eed5811755fa tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:11.891996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b87cc9d-09a0-4a3c-b897-eed5811755fa tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:11.892447 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b87cc9d-09a0-4a3c-b897-eed5811755fa tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:11.893212 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b87cc9d-09a0-4a3c-b897-eed5811755fa tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:11.893648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b87cc9d-09a0-4a3c-b897-eed5811755fa tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:12.038195 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6b87cc9d-09a0-4a3c-b897-eed5811755fa tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:12.046277 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6b87cc9d-09a0-4a3c-b897-eed5811755fa tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1574 microversion: 2.1 time: 0.165612 Jul 12 13:48:12.046918 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 420/830] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:11 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:12.896684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b9b6d967-725c-45fb-84b5-9e26f82a2802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:12.897741 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b9b6d967-725c-45fb-84b5-9e26f82a2802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:12.904083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b9b6d967-725c-45fb-84b5-9e26f82a2802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:12.904535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b9b6d967-725c-45fb-84b5-9e26f82a2802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:12.905301 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b9b6d967-725c-45fb-84b5-9e26f82a2802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:12.905763 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b9b6d967-725c-45fb-84b5-9e26f82a2802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:13.038816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b9b6d967-725c-45fb-84b5-9e26f82a2802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:13.047313 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b9b6d967-725c-45fb-84b5-9e26f82a2802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:13.048812 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b9b6d967-725c-45fb-84b5-9e26f82a2802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:13.049985 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b9b6d967-725c-45fb-84b5-9e26f82a2802 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1742 microversion: 2.20 time: 0.157213 Jul 12 13:48:13.050563 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 421/831] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:12 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:13.066421 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-71159aa7-314e-4a57-8d8f-7c2e472e44ff tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:13.067041 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-71159aa7-314e-4a57-8d8f-7c2e472e44ff tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:13.072989 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71159aa7-314e-4a57-8d8f-7c2e472e44ff tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:13.073467 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71159aa7-314e-4a57-8d8f-7c2e472e44ff tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:13.074265 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71159aa7-314e-4a57-8d8f-7c2e472e44ff tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:13.074697 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-71159aa7-314e-4a57-8d8f-7c2e472e44ff tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:13.214232 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-71159aa7-314e-4a57-8d8f-7c2e472e44ff tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:13.221619 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-71159aa7-314e-4a57-8d8f-7c2e472e44ff tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1574 microversion: 2.1 time: 0.161756 Jul 12 13:48:13.222339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 422/832] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:13 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:48:14.068915 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-87e465bf-ddbd-4a6d-bfc8-f3e6b2f20d73 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:14.069567 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-87e465bf-ddbd-4a6d-bfc8-f3e6b2f20d73 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:14.076919 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-87e465bf-ddbd-4a6d-bfc8-f3e6b2f20d73 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:14.077381 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-87e465bf-ddbd-4a6d-bfc8-f3e6b2f20d73 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:14.078191 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-87e465bf-ddbd-4a6d-bfc8-f3e6b2f20d73 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:14.078638 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-87e465bf-ddbd-4a6d-bfc8-f3e6b2f20d73 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:14.214881 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-87e465bf-ddbd-4a6d-bfc8-f3e6b2f20d73 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:14.222851 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-87e465bf-ddbd-4a6d-bfc8-f3e6b2f20d73 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:14.224377 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-87e465bf-ddbd-4a6d-bfc8-f3e6b2f20d73 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:14.225542 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-87e465bf-ddbd-4a6d-bfc8-f3e6b2f20d73 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1742 microversion: 2.20 time: 0.160604 Jul 12 13:48:14.226128 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 423/833] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:14 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:14.239121 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c9168ffe-04bc-48a5-9a64-620c45589b72 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:14.239717 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c9168ffe-04bc-48a5-9a64-620c45589b72 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:14.245792 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9168ffe-04bc-48a5-9a64-620c45589b72 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:14.246539 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9168ffe-04bc-48a5-9a64-620c45589b72 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:14.247492 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9168ffe-04bc-48a5-9a64-620c45589b72 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:14.248286 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c9168ffe-04bc-48a5-9a64-620c45589b72 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:14.432001 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b395f024-b95e-4f4e-8bad-3de56f51c646 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.714065 Jul 12 13:48:14.432981 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 411/834] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:48:10 2022] POST /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments => generated 194 bytes in 3716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:14.441661 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c9168ffe-04bc-48a5-9a64-620c45589b72 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:14.450953 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c9168ffe-04bc-48a5-9a64-620c45589b72 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1574 microversion: 2.1 time: 0.215398 Jul 12 13:48:14.451560 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 424/835] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:14 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1574 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:15.249982 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-08e21f5a-69b9-43e1-99fe-9153c7a6e7be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:15.250920 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-08e21f5a-69b9-43e1-99fe-9153c7a6e7be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:15.257930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-08e21f5a-69b9-43e1-99fe-9153c7a6e7be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:15.258443 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-08e21f5a-69b9-43e1-99fe-9153c7a6e7be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:15.259230 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-08e21f5a-69b9-43e1-99fe-9153c7a6e7be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:15.259755 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-08e21f5a-69b9-43e1-99fe-9153c7a6e7be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:15.432817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-08e21f5a-69b9-43e1-99fe-9153c7a6e7be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:15.443663 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-08e21f5a-69b9-43e1-99fe-9153c7a6e7be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:15.447238 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-08e21f5a-69b9-43e1-99fe-9153c7a6e7be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:15.454251 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-08e21f5a-69b9-43e1-99fe-9153c7a6e7be tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.210314 Jul 12 13:48:15.454859 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 412/836] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:15 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:15.469613 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-939af005-7bac-4b86-ad15-78f7c8c852d1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:15.470034 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-939af005-7bac-4b86-ad15-78f7c8c852d1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:15.475278 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:15.476745 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-939af005-7bac-4b86-ad15-78f7c8c852d1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:15.477200 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-939af005-7bac-4b86-ad15-78f7c8c852d1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:15.478019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-939af005-7bac-4b86-ad15-78f7c8c852d1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:15.478473 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-939af005-7bac-4b86-ad15-78f7c8c852d1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:15.663682 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-930050a5-f4ee-4dd1-b812-61d3430cf059 req-40ced7d1-5ca9-4a66-9cb1-a14cd2ef93b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c496f49-2bd0-4b55-bca1-6402b331e1a1", "name": "network-vif-deleted", "tag": "dd8d0273-59e6-4628-b80c-fb8d75a315d0"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:15.670556 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-939af005-7bac-4b86-ad15-78f7c8c852d1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb11db914a57439bada24b5f755a143a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edae8cd268da40a3b8e2affe277bc56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:15.701995 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-939af005-7bac-4b86-ad15-78f7c8c852d1 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 200 len: 1388 microversion: 2.1 time: 0.234696 Jul 12 13:48:15.702677 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 425/837] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:15 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 1388 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:15.703262 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-930050a5-f4ee-4dd1-b812-61d3430cf059 req-40ced7d1-5ca9-4a66-9cb1-a14cd2ef93b2 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:15.703930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-930050a5-f4ee-4dd1-b812-61d3430cf059 req-40ced7d1-5ca9-4a66-9cb1-a14cd2ef93b2 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:15.723008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-930050a5-f4ee-4dd1-b812-61d3430cf059 req-40ced7d1-5ca9-4a66-9cb1-a14cd2ef93b2 service nova] Creating event network-vif-deleted:dd8d0273-59e6-4628-b80c-fb8d75a315d0 for instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 on hv-cinder-79797 Jul 12 13:48:15.735964 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-930050a5-f4ee-4dd1-b812-61d3430cf059 req-40ced7d1-5ca9-4a66-9cb1-a14cd2ef93b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075067 Jul 12 13:48:15.736734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 413/838] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:48:16.474591 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-401b088a-641e-4421-9fde-f1b0024e968d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:16.475882 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-401b088a-641e-4421-9fde-f1b0024e968d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:16.485040 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-401b088a-641e-4421-9fde-f1b0024e968d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:16.485734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-401b088a-641e-4421-9fde-f1b0024e968d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:16.486760 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-401b088a-641e-4421-9fde-f1b0024e968d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:16.487364 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-401b088a-641e-4421-9fde-f1b0024e968d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:16.716627 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-401b088a-641e-4421-9fde-f1b0024e968d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:16.723171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-04e01786-eb7c-4e76-9a1f-5159c3f20555 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:16.724435 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-04e01786-eb7c-4e76-9a1f-5159c3f20555 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] [instance: 5c496f49-2bd0-4b55-bca1-6402b331e1a1] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:16.726290 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-401b088a-641e-4421-9fde-f1b0024e968d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:16.727752 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-401b088a-641e-4421-9fde-f1b0024e968d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:16.729688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-401b088a-641e-4421-9fde-f1b0024e968d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.260453 Jul 12 13:48:16.734295 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 426/839] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:16 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:16.738596 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-04e01786-eb7c-4e76-9a1f-5159c3f20555 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:16.739047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-04e01786-eb7c-4e76-9a1f-5159c3f20555 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:16.739825 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-04e01786-eb7c-4e76-9a1f-5159c3f20555 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:16.740259 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-04e01786-eb7c-4e76-9a1f-5159c3f20555 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:16.765072 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-04e01786-eb7c-4e76-9a1f-5159c3f20555 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] HTTP exception thrown: Instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 could not be found. Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-04e01786-eb7c-4e76-9a1f-5159c3f20555 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Request method failure captured: Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 HTTP/1.1 Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXp6r87aeVTLddVruPOOnwIgyAOASscgtxE6bAAtw2RaHY_in29a875cfSDMkspM5x7oPO3Kt6h1H6Bc0fA17ipXsrJuu5eq0V9UYdw_QTv0-SfBCGA3R8jLAWbA2Q4kBfyEhNR1Hne0eUxaGYd3KdUAQoZia7FbV-cmdjgAJNS_mKc Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: edae8cd268da40a3b8e2affe277bc56e Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-TestVolumeBootPattern-1865141326 Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:48:16.766800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/edae8cd268da40a3b8e2affe277bc56e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/edae8cd268da40a3b8e2affe277bc56e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/edae8cd268da40a3b8e2affe277bc56e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_edae8cd268da40a3b8e2affe277bc56e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-TestVolumeBootPattern-1865141326 Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: edae8cd268da40a3b8e2affe277bc56e Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-TestVolumeBootPattern-1865141326 Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-TestVolumeBootPattern-1865141326-project Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: bb11db914a57439bada24b5f755a143a Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-TestVolumeBootPattern-1865141326-project Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 could not be found. Jul 12 13:48:16.768397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '5c496f49-2bd0-4b55-bca1-6402b331e1a1'} Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 could not be found. Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:48:16.769302 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 could not be found. Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 could not be found. Jul 12 13:48:16.770917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:16.773446 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-04e01786-eb7c-4e76-9a1f-5159c3f20555 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Returning 404 to user: Instance 5c496f49-2bd0-4b55-bca1-6402b331e1a1 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:48:16.774609 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-04e01786-eb7c-4e76-9a1f-5159c3f20555 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1" status: 404 len: 111 microversion: 2.1 time: 0.056880 Jul 12 13:48:16.775720 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 414/840] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:16 2022] GET /compute/v2.1/servers/5c496f49-2bd0-4b55-bca1-6402b331e1a1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:48:17.747751 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4762fcfc-51ea-438c-804b-5c7081861a7e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:17.749327 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4762fcfc-51ea-438c-804b-5c7081861a7e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:17.768005 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4762fcfc-51ea-438c-804b-5c7081861a7e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:17.768721 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4762fcfc-51ea-438c-804b-5c7081861a7e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:17.769726 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4762fcfc-51ea-438c-804b-5c7081861a7e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:17.770459 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4762fcfc-51ea-438c-804b-5c7081861a7e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:17.914558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4762fcfc-51ea-438c-804b-5c7081861a7e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:17.923814 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4762fcfc-51ea-438c-804b-5c7081861a7e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:17.925432 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4762fcfc-51ea-438c-804b-5c7081861a7e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:17.926736 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4762fcfc-51ea-438c-804b-5c7081861a7e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.183177 Jul 12 13:48:17.927377 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 427/841] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:17 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:18.161492 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-07a3bdb0-685f-4e5f-accf-3c5ea1d9e5b2 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] Calling method '.version_select at 0x7f3a15b17040>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:18.220628 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-07a3bdb0-685f-4e5f-accf-3c5ea1d9e5b2 tempest-TestVolumeBootPattern-1865141326 tempest-TestVolumeBootPattern-1865141326-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2014345130" status: 202 len: 0 microversion: 2.1 time: 0.063332 Jul 12 13:48:18.221206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 415/842] 10.222.0.52 () {58 vars in 1262 bytes} [Tue Jul 12 13:48:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2014345130 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:48:18.944779 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-860a45c8-cf37-47eb-b862-5036b1cc50b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:18.945415 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-860a45c8-cf37-47eb-b862-5036b1cc50b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:18.954168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-860a45c8-cf37-47eb-b862-5036b1cc50b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:18.954627 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-860a45c8-cf37-47eb-b862-5036b1cc50b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:18.955403 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-860a45c8-cf37-47eb-b862-5036b1cc50b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:18.955860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-860a45c8-cf37-47eb-b862-5036b1cc50b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:19.147709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-860a45c8-cf37-47eb-b862-5036b1cc50b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:19.155986 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-860a45c8-cf37-47eb-b862-5036b1cc50b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:19.157568 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-860a45c8-cf37-47eb-b862-5036b1cc50b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:19.158999 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-860a45c8-cf37-47eb-b862-5036b1cc50b5 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.218216 Jul 12 13:48:19.169453 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 428/843] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:18 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:20.177356 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-10cf6b9d-b236-4f74-9e77-18424c77977d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:20.179063 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-10cf6b9d-b236-4f74-9e77-18424c77977d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:20.202289 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-10cf6b9d-b236-4f74-9e77-18424c77977d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:20.203239 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-10cf6b9d-b236-4f74-9e77-18424c77977d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:20.204910 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-10cf6b9d-b236-4f74-9e77-18424c77977d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:20.206030 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-10cf6b9d-b236-4f74-9e77-18424c77977d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:20.546105 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-10cf6b9d-b236-4f74-9e77-18424c77977d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:20.576376 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-10cf6b9d-b236-4f74-9e77-18424c77977d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:20.582130 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-10cf6b9d-b236-4f74-9e77-18424c77977d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:20.584547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-10cf6b9d-b236-4f74-9e77-18424c77977d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.411422 Jul 12 13:48:20.585761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 416/844] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:20 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:21.605363 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-157a48bb-a268-4c5f-bd10-b442975cb4ef tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:21.606051 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-157a48bb-a268-4c5f-bd10-b442975cb4ef tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:21.616174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-157a48bb-a268-4c5f-bd10-b442975cb4ef tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:21.616579 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-157a48bb-a268-4c5f-bd10-b442975cb4ef tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:21.617413 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-157a48bb-a268-4c5f-bd10-b442975cb4ef tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:21.617903 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-157a48bb-a268-4c5f-bd10-b442975cb4ef tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:21.976853 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-157a48bb-a268-4c5f-bd10-b442975cb4ef tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:21.986768 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-157a48bb-a268-4c5f-bd10-b442975cb4ef tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:21.991055 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-157a48bb-a268-4c5f-bd10-b442975cb4ef tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:21.993890 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-157a48bb-a268-4c5f-bd10-b442975cb4ef tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.393271 Jul 12 13:48:21.996020 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 429/845] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:21 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:22.307101 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-08ec4cdf-03d6-4a08-a46a-6fb026b5efb0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:22.308683 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-08ec4cdf-03d6-4a08-a46a-6fb026b5efb0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:22.315951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-08ec4cdf-03d6-4a08-a46a-6fb026b5efb0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:22.316626 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-08ec4cdf-03d6-4a08-a46a-6fb026b5efb0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:22.317593 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-08ec4cdf-03d6-4a08-a46a-6fb026b5efb0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:22.318243 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-08ec4cdf-03d6-4a08-a46a-6fb026b5efb0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:22.392050 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-08ec4cdf-03d6-4a08-a46a-6fb026b5efb0 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088888 Jul 12 13:48:22.393892 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 417/846] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:48:22 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:22.404227 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-08331ac7-7b9c-42de-88a1-f5ac6220e03a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:22.404794 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-08331ac7-7b9c-42de-88a1-f5ac6220e03a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:22.416058 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-08331ac7-7b9c-42de-88a1-f5ac6220e03a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:22.419311 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-08331ac7-7b9c-42de-88a1-f5ac6220e03a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:22.421274 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-08331ac7-7b9c-42de-88a1-f5ac6220e03a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:22.421747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-08331ac7-7b9c-42de-88a1-f5ac6220e03a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:22.470313 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-08331ac7-7b9c-42de-88a1-f5ac6220e03a tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments/a1d0d75c-b4aa-4364-9a87-7cd508ad9a39" status: 200 len: 194 microversion: 2.1 time: 0.071370 Jul 12 13:48:22.470937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 430/847] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Jul 12 13:48:22 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments/a1d0d75c-b4aa-4364-9a87-7cd508ad9a39 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:23.013488 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3e13bb7b-0019-491d-9ac7-9e93a2b2ce2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:23.014329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3e13bb7b-0019-491d-9ac7-9e93a2b2ce2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:23.034525 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3e13bb7b-0019-491d-9ac7-9e93a2b2ce2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:23.047271 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3e13bb7b-0019-491d-9ac7-9e93a2b2ce2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:23.051331 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3e13bb7b-0019-491d-9ac7-9e93a2b2ce2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:23.052081 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3e13bb7b-0019-491d-9ac7-9e93a2b2ce2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:23.424092 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3e13bb7b-0019-491d-9ac7-9e93a2b2ce2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:23.444228 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3e13bb7b-0019-491d-9ac7-9e93a2b2ce2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:23.447193 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3e13bb7b-0019-491d-9ac7-9e93a2b2ce2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:23.448802 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3e13bb7b-0019-491d-9ac7-9e93a2b2ce2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.439647 Jul 12 13:48:23.449585 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 418/848] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:23 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:24.292430 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-aa2019ae-7f87-412b-9d6a-5e0b53e644af tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b074a03d-9b1e-462e-b536-14fbce4ba2c7"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:24.299435 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-aa2019ae-7f87-412b-9d6a-5e0b53e644af tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:24.313173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa2019ae-7f87-412b-9d6a-5e0b53e644af tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:24.313780 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa2019ae-7f87-412b-9d6a-5e0b53e644af tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:24.315652 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa2019ae-7f87-412b-9d6a-5e0b53e644af tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:24.316267 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-aa2019ae-7f87-412b-9d6a-5e0b53e644af tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:24.480078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-23752d07-89bd-428f-88d5-0294ba9f67e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:24.480740 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-23752d07-89bd-428f-88d5-0294ba9f67e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:24.496489 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-23752d07-89bd-428f-88d5-0294ba9f67e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:24.496489 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-23752d07-89bd-428f-88d5-0294ba9f67e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:24.512875 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-23752d07-89bd-428f-88d5-0294ba9f67e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:24.513468 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-23752d07-89bd-428f-88d5-0294ba9f67e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:24.762975 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:24.781527 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-aa2019ae-7f87-412b-9d6a-5e0b53e644af tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "POST /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492888 Jul 12 13:48:24.801436 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 431/849] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:48:24 2022] POST /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:25.175017 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-23752d07-89bd-428f-88d5-0294ba9f67e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:25.185809 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-23752d07-89bd-428f-88d5-0294ba9f67e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:25.191208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-23752d07-89bd-428f-88d5-0294ba9f67e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:25.195664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-23752d07-89bd-428f-88d5-0294ba9f67e6 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.723682 Jul 12 13:48:25.199047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 419/850] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:24 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:26.224588 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b03c1c40-9332-4fbd-a478-7bfed4b8491b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:26.226045 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b03c1c40-9332-4fbd-a478-7bfed4b8491b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:26.241036 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b03c1c40-9332-4fbd-a478-7bfed4b8491b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:26.243213 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b03c1c40-9332-4fbd-a478-7bfed4b8491b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:26.244093 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b03c1c40-9332-4fbd-a478-7bfed4b8491b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:26.244618 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b03c1c40-9332-4fbd-a478-7bfed4b8491b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:26.665611 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b03c1c40-9332-4fbd-a478-7bfed4b8491b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:26.676524 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b03c1c40-9332-4fbd-a478-7bfed4b8491b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:26.687698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b03c1c40-9332-4fbd-a478-7bfed4b8491b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:26.692237 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b03c1c40-9332-4fbd-a478-7bfed4b8491b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.475191 Jul 12 13:48:26.707492 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 432/851] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:26 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:27.721928 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-549bbf49-7a6a-470d-babb-f154664b8e0b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:27.722697 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-549bbf49-7a6a-470d-babb-f154664b8e0b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:27.766401 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-549bbf49-7a6a-470d-babb-f154664b8e0b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:27.767298 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-549bbf49-7a6a-470d-babb-f154664b8e0b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:27.768225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-549bbf49-7a6a-470d-babb-f154664b8e0b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:27.768579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-549bbf49-7a6a-470d-babb-f154664b8e0b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:28.478716 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-549bbf49-7a6a-470d-babb-f154664b8e0b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:28.489051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-549bbf49-7a6a-470d-babb-f154664b8e0b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:28.493300 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-549bbf49-7a6a-470d-babb-f154664b8e0b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:28.497728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-549bbf49-7a6a-470d-babb-f154664b8e0b tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.783134 Jul 12 13:48:28.516276 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 420/852] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:27 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:29.522291 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-889c89b7-b00e-4370-b10b-781efc519765 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:29.522933 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-889c89b7-b00e-4370-b10b-781efc519765 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:29.536425 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-889c89b7-b00e-4370-b10b-781efc519765 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:29.536993 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-889c89b7-b00e-4370-b10b-781efc519765 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:29.538016 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-889c89b7-b00e-4370-b10b-781efc519765 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:29.538472 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-889c89b7-b00e-4370-b10b-781efc519765 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:29.982086 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-889c89b7-b00e-4370-b10b-781efc519765 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:30.023895 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-889c89b7-b00e-4370-b10b-781efc519765 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:30.034653 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-889c89b7-b00e-4370-b10b-781efc519765 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:30.040080 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-889c89b7-b00e-4370-b10b-781efc519765 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.522079 Jul 12 13:48:30.054710 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 433/853] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:29 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:31.073837 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b32b4df1-9add-49b1-9fcc-2cf97b75fc06 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:31.074534 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b32b4df1-9add-49b1-9fcc-2cf97b75fc06 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:31.088792 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b32b4df1-9add-49b1-9fcc-2cf97b75fc06 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:31.089305 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b32b4df1-9add-49b1-9fcc-2cf97b75fc06 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:31.098995 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b32b4df1-9add-49b1-9fcc-2cf97b75fc06 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:31.103011 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b32b4df1-9add-49b1-9fcc-2cf97b75fc06 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:31.623093 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b32b4df1-9add-49b1-9fcc-2cf97b75fc06 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:31.634847 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b32b4df1-9add-49b1-9fcc-2cf97b75fc06 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:31.636579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b32b4df1-9add-49b1-9fcc-2cf97b75fc06 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:31.637825 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b32b4df1-9add-49b1-9fcc-2cf97b75fc06 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1737 microversion: 2.20 time: 0.568630 Jul 12 13:48:31.672047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 421/854] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:31 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1737 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:31.975186 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-844d9d09-fcf7-4202-bfdd-2484c17e47a7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:31.976529 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-844d9d09-fcf7-4202-bfdd-2484c17e47a7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:31.991655 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-844d9d09-fcf7-4202-bfdd-2484c17e47a7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:31.994252 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-844d9d09-fcf7-4202-bfdd-2484c17e47a7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:31.997362 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-844d9d09-fcf7-4202-bfdd-2484c17e47a7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:32.001652 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-844d9d09-fcf7-4202-bfdd-2484c17e47a7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:32.095130 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-844d9d09-fcf7-4202-bfdd-2484c17e47a7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.124612 Jul 12 13:48:32.095727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 434/855] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:48:31 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:32.204050 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0c62752a-3e5e-4308-9213-72fd4ef4b224 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:32.205684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0c62752a-3e5e-4308-9213-72fd4ef4b224 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:32.216098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0c62752a-3e5e-4308-9213-72fd4ef4b224 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:32.263549 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0c62752a-3e5e-4308-9213-72fd4ef4b224 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.047s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:32.266907 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0c62752a-3e5e-4308-9213-72fd4ef4b224 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:32.267399 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0c62752a-3e5e-4308-9213-72fd4ef4b224 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:32.372366 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0c62752a-3e5e-4308-9213-72fd4ef4b224 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments/a1d0d75c-b4aa-4364-9a87-7cd508ad9a39" status: 200 len: 194 microversion: 2.1 time: 0.175615 Jul 12 13:48:32.376149 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 422/856] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Jul 12 13:48:32 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments/a1d0d75c-b4aa-4364-9a87-7cd508ad9a39 => generated 194 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:32.383291 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c69c0533-1a74-48e6-86ff-1f0abd7f9fec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:32.384462 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c69c0533-1a74-48e6-86ff-1f0abd7f9fec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:32.390509 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c69c0533-1a74-48e6-86ff-1f0abd7f9fec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:32.398685 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c69c0533-1a74-48e6-86ff-1f0abd7f9fec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:32.399577 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c69c0533-1a74-48e6-86ff-1f0abd7f9fec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:32.409110 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c69c0533-1a74-48e6-86ff-1f0abd7f9fec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:32.637936 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-c69c0533-1a74-48e6-86ff-1f0abd7f9fec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lazy-loading 'services' on Instance uuid a0a89058-e7f4-4e1a-8298-0fad022102c5 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:48:32.695765 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1cdf63a1-5221-467b-96f2-c3f8b4beefbb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:32.696111 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1cdf63a1-5221-467b-96f2-c3f8b4beefbb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:32.728831 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1cdf63a1-5221-467b-96f2-c3f8b4beefbb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:32.729633 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1cdf63a1-5221-467b-96f2-c3f8b4beefbb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:32.730777 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1cdf63a1-5221-467b-96f2-c3f8b4beefbb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:32.731436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1cdf63a1-5221-467b-96f2-c3f8b4beefbb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:32.831098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c69c0533-1a74-48e6-86ff-1f0abd7f9fec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments/a1d0d75c-b4aa-4364-9a87-7cd508ad9a39" status: 202 len: 0 microversion: 2.1 time: 0.450362 Jul 12 13:48:32.832962 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 435/857] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:48:32 2022] DELETE /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments/a1d0d75c-b4aa-4364-9a87-7cd508ad9a39 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:48:32.978092 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1cdf63a1-5221-467b-96f2-c3f8b4beefbb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:32.995632 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1cdf63a1-5221-467b-96f2-c3f8b4beefbb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:32.998155 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1cdf63a1-5221-467b-96f2-c3f8b4beefbb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:32.999980 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1cdf63a1-5221-467b-96f2-c3f8b4beefbb tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1719 microversion: 2.20 time: 0.322452 Jul 12 13:48:33.002233 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 423/858] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:32 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1719 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:34.034278 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bca9cc48-ea87-45b2-912c-0140e2636c11 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:34.034806 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bca9cc48-ea87-45b2-912c-0140e2636c11 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:34.049531 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bca9cc48-ea87-45b2-912c-0140e2636c11 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:34.050005 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bca9cc48-ea87-45b2-912c-0140e2636c11 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:34.059007 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bca9cc48-ea87-45b2-912c-0140e2636c11 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:34.059577 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bca9cc48-ea87-45b2-912c-0140e2636c11 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:34.140289 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3fcea967-7b2e-4217-925a-a06a0e541850 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:34.141105 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3fcea967-7b2e-4217-925a-a06a0e541850 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:34.152600 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3fcea967-7b2e-4217-925a-a06a0e541850 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:34.153846 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3fcea967-7b2e-4217-925a-a06a0e541850 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:34.155210 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3fcea967-7b2e-4217-925a-a06a0e541850 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:34.156288 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3fcea967-7b2e-4217-925a-a06a0e541850 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:34.196967 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3fcea967-7b2e-4217-925a-a06a0e541850 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments/b074a03d-9b1e-462e-b536-14fbce4ba2c7" status: 200 len: 194 microversion: 2.1 time: 0.061764 Jul 12 13:48:34.198576 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 424/859] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Jul 12 13:48:34 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments/b074a03d-9b1e-462e-b536-14fbce4ba2c7 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:34.208612 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e1b2c4ea-bf72-4985-99cf-7596feda0bd6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:34.209839 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e1b2c4ea-bf72-4985-99cf-7596feda0bd6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:34.217343 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e1b2c4ea-bf72-4985-99cf-7596feda0bd6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:34.218347 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e1b2c4ea-bf72-4985-99cf-7596feda0bd6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:34.219705 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e1b2c4ea-bf72-4985-99cf-7596feda0bd6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:34.220399 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e1b2c4ea-bf72-4985-99cf-7596feda0bd6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:34.225737 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:34.339970 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-e1b2c4ea-bf72-4985-99cf-7596feda0bd6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lazy-loading 'services' on Instance uuid a0a89058-e7f4-4e1a-8298-0fad022102c5 {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:48:34.490015 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bca9cc48-ea87-45b2-912c-0140e2636c11 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:34.500162 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bca9cc48-ea87-45b2-912c-0140e2636c11 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:34.504037 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-bca9cc48-ea87-45b2-912c-0140e2636c11 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:34.509741 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bca9cc48-ea87-45b2-912c-0140e2636c11 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1719 microversion: 2.20 time: 0.480426 Jul 12 13:48:34.514014 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 436/860] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:34 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1719 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:34.789208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e1b2c4ea-bf72-4985-99cf-7596feda0bd6 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments/b074a03d-9b1e-462e-b536-14fbce4ba2c7" status: 202 len: 0 microversion: 2.1 time: 0.583925 Jul 12 13:48:34.789208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 425/861] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:48:34 2022] DELETE /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments/b074a03d-9b1e-462e-b536-14fbce4ba2c7 => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:48:35.530445 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-c585aea5-b849-4dd8-8568-bcb0752d9a19 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:35.531306 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-c585aea5-b849-4dd8-8568-bcb0752d9a19 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:35.559946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c585aea5-b849-4dd8-8568-bcb0752d9a19 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:35.560411 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c585aea5-b849-4dd8-8568-bcb0752d9a19 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:35.561227 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c585aea5-b849-4dd8-8568-bcb0752d9a19 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:35.561666 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-c585aea5-b849-4dd8-8568-bcb0752d9a19 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:35.873670 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c585aea5-b849-4dd8-8568-bcb0752d9a19 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:35.883609 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c585aea5-b849-4dd8-8568-bcb0752d9a19 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:35.886378 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-c585aea5-b849-4dd8-8568-bcb0752d9a19 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:35.888235 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-c585aea5-b849-4dd8-8568-bcb0752d9a19 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1719 microversion: 2.20 time: 0.363075 Jul 12 13:48:35.889594 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 437/862] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:35 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1719 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:36.818646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8fe2687c-f058-4551-bfb5-c07c1b499e8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:36.826797 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8fe2687c-f058-4551-bfb5-c07c1b499e8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:36.883513 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8fe2687c-f058-4551-bfb5-c07c1b499e8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:36.884529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8fe2687c-f058-4551-bfb5-c07c1b499e8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:36.886864 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8fe2687c-f058-4551-bfb5-c07c1b499e8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:36.887829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8fe2687c-f058-4551-bfb5-c07c1b499e8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:36.912327 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-421faf52-cf8c-4cea-9d41-62eba9f530e7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:36.914539 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-421faf52-cf8c-4cea-9d41-62eba9f530e7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:36.945231 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-421faf52-cf8c-4cea-9d41-62eba9f530e7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:36.950857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-421faf52-cf8c-4cea-9d41-62eba9f530e7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:36.954286 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-421faf52-cf8c-4cea-9d41-62eba9f530e7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:36.956865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-421faf52-cf8c-4cea-9d41-62eba9f530e7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:37.021951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8fe2687c-f058-4551-bfb5-c07c1b499e8d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/ips" status: 200 len: 149 microversion: 2.1 time: 0.223673 Jul 12 13:48:37.035008 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 426/863] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jul 12 13:48:36 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/ips => generated 149 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:37.236651 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-3476b335-0542-4226-8ddb-df04ae348dd3 req-ea4114aa-bace-4cd6-9f64-2bf50975bb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ae49d6-301e-4cf8-9037-3b59098c81c9", "name": "network-vif-unplugged", "status": "completed", "tag": "f5b2cadb-da8b-47ae-8893-71246ab085ad"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:37.270922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-3476b335-0542-4226-8ddb-df04ae348dd3 req-ea4114aa-bace-4cd6-9f64-2bf50975bb9c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:37.274704 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-3476b335-0542-4226-8ddb-df04ae348dd3 req-ea4114aa-bace-4cd6-9f64-2bf50975bb9c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:37.326605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.compute.server_external_events [req-3476b335-0542-4226-8ddb-df04ae348dd3 req-ea4114aa-bace-4cd6-9f64-2bf50975bb9c service nova] Unable to find a host for instance f1ae49d6-301e-4cf8-9037-3b59098c81c9. Dropping event network-vif-unplugged {{(pid=124465) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 13:48:37.332500 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-3476b335-0542-4226-8ddb-df04ae348dd3 req-ea4114aa-bace-4cd6-9f64-2bf50975bb9c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.100282 Jul 12 13:48:37.338051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 427/864] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 106 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 12 13:48:37.417560 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-421faf52-cf8c-4cea-9d41-62eba9f530e7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:37.428555 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-421faf52-cf8c-4cea-9d41-62eba9f530e7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:37.434481 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3c6c41d7-fb28-4456-b7b3-fa1cfebcc827 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:37.436496 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3c6c41d7-fb28-4456-b7b3-fa1cfebcc827 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:37.444684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-421faf52-cf8c-4cea-9d41-62eba9f530e7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:37.450636 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-421faf52-cf8c-4cea-9d41-62eba9f530e7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1662 microversion: 2.20 time: 0.541967 Jul 12 13:48:37.453657 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c6c41d7-fb28-4456-b7b3-fa1cfebcc827 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:37.455128 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 438/865] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:36 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1662 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:37.455505 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c6c41d7-fb28-4456-b7b3-fa1cfebcc827 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:37.457043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c6c41d7-fb28-4456-b7b3-fa1cfebcc827 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:37.458708 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c6c41d7-fb28-4456-b7b3-fa1cfebcc827 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:37.478129 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-bb00b125-5101-4fd4-bcdd-3895db900eed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8850cc39-d98c-4f6a-9b1d-009dba0977b4"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:37.480163 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-bb00b125-5101-4fd4-bcdd-3895db900eed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:37.495845 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb00b125-5101-4fd4-bcdd-3895db900eed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:37.496712 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb00b125-5101-4fd4-bcdd-3895db900eed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:37.498210 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb00b125-5101-4fd4-bcdd-3895db900eed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:37.499016 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-bb00b125-5101-4fd4-bcdd-3895db900eed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:37.520250 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3c6c41d7-fb28-4456-b7b3-fa1cfebcc827 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090106 Jul 12 13:48:37.522177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 428/866] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:48:37 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:48:37.830872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-692787fc-3361-4c1e-a538-381245ba184e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:37.832026 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-692787fc-3361-4c1e-a538-381245ba184e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:37.841228 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-692787fc-3361-4c1e-a538-381245ba184e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:37.841939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-692787fc-3361-4c1e-a538-381245ba184e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:37.850211 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-692787fc-3361-4c1e-a538-381245ba184e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:37.850835 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-692787fc-3361-4c1e-a538-381245ba184e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:37.935840 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-692787fc-3361-4c1e-a538-381245ba184e tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109610 Jul 12 13:48:37.937060 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 429/867] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:48:37 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:48:38.132865 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a315a9c4-3e56-4f34-84d1-3569489c9a54 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:38.133388 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a315a9c4-3e56-4f34-84d1-3569489c9a54 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:38.135569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:38.147494 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a315a9c4-3e56-4f34-84d1-3569489c9a54 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:38.147951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a315a9c4-3e56-4f34-84d1-3569489c9a54 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:38.148818 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a315a9c4-3e56-4f34-84d1-3569489c9a54 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:38.149259 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a315a9c4-3e56-4f34-84d1-3569489c9a54 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:38.245461 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a315a9c4-3e56-4f34-84d1-3569489c9a54 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:48:38.310088 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bb00b125-5101-4fd4-bcdd-3895db900eed tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "POST /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.837956 Jul 12 13:48:38.311900 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 439/868] 10.222.0.52 () {62 vars in 1363 bytes} [Tue Jul 12 13:48:37 2022] POST /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/os-volume_attachments => generated 188 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 13:48:38.427714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a315a9c4-3e56-4f34-84d1-3569489c9a54 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 204 len: 0 microversion: 2.1 time: 0.299139 Jul 12 13:48:38.427714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 430/869] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:48:38 2022] DELETE /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 13:48:38.437883 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6977511a-6d48-4630-b2d4-c5f374348cb4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:38.438678 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6977511a-6d48-4630-b2d4-c5f374348cb4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:38.461428 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6977511a-6d48-4630-b2d4-c5f374348cb4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:38.463691 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6977511a-6d48-4630-b2d4-c5f374348cb4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:38.466500 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6977511a-6d48-4630-b2d4-c5f374348cb4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:38.467041 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6977511a-6d48-4630-b2d4-c5f374348cb4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:38.561999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a3a6d5f3-be88-4f2e-be67-0e69aa51e6fe tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:38.562790 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a3a6d5f3-be88-4f2e-be67-0e69aa51e6fe tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:38.575298 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a3a6d5f3-be88-4f2e-be67-0e69aa51e6fe tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:38.579160 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a3a6d5f3-be88-4f2e-be67-0e69aa51e6fe tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:38.580598 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a3a6d5f3-be88-4f2e-be67-0e69aa51e6fe tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:38.582851 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a3a6d5f3-be88-4f2e-be67-0e69aa51e6fe tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:38.922937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6977511a-6d48-4630-b2d4-c5f374348cb4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:38.940258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6977511a-6d48-4630-b2d4-c5f374348cb4 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1673 microversion: 2.1 time: 0.502506 Jul 12 13:48:38.948119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 440/870] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:38 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1673 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:39.068316 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-465c4f1c-c52b-4dbb-9a58-37621f6da06b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b060835e-4665-4857-ae00-3a890c62db45"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:39.069923 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-465c4f1c-c52b-4dbb-9a58-37621f6da06b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:39.077486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-465c4f1c-c52b-4dbb-9a58-37621f6da06b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:39.078213 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-465c4f1c-c52b-4dbb-9a58-37621f6da06b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:39.079138 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-465c4f1c-c52b-4dbb-9a58-37621f6da06b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:39.079731 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-465c4f1c-c52b-4dbb-9a58-37621f6da06b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:39.157602 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a3a6d5f3-be88-4f2e-be67-0e69aa51e6fe tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/os-volume_attachments/8850cc39-d98c-4f6a-9b1d-009dba0977b4" status: 202 len: 0 microversion: 2.20 time: 0.598837 Jul 12 13:48:39.164687 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 431/871] 10.222.0.52 () {60 vars in 1456 bytes} [Tue Jul 12 13:48:38 2022] DELETE /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/os-volume_attachments/8850cc39-d98c-4f6a-9b1d-009dba0977b4 => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:48:39.295780 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-21755f8f-3d40-4f2c-b9e9-f6eb79dc5b59 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:39.296608 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-21755f8f-3d40-4f2c-b9e9-f6eb79dc5b59 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:39.308807 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-21755f8f-3d40-4f2c-b9e9-f6eb79dc5b59 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:39.309862 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-21755f8f-3d40-4f2c-b9e9-f6eb79dc5b59 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:39.315528 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-21755f8f-3d40-4f2c-b9e9-f6eb79dc5b59 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:39.315999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-21755f8f-3d40-4f2c-b9e9-f6eb79dc5b59 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:39.433512 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-21755f8f-3d40-4f2c-b9e9-f6eb79dc5b59 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "POST /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/action" status: 202 len: 0 microversion: 2.20 time: 0.141612 Jul 12 13:48:39.437267 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 432/872] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Jul 12 13:48:39 2022] POST /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 13:48:39.454930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0619b3ad-3cf6-4ffe-8ae0-721eb2fe2ca3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:39.458291 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0619b3ad-3cf6-4ffe-8ae0-721eb2fe2ca3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:39.473072 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0619b3ad-3cf6-4ffe-8ae0-721eb2fe2ca3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:39.473782 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0619b3ad-3cf6-4ffe-8ae0-721eb2fe2ca3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:39.475000 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0619b3ad-3cf6-4ffe-8ae0-721eb2fe2ca3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:39.475605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0619b3ad-3cf6-4ffe-8ae0-721eb2fe2ca3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:39.685576 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0619b3ad-3cf6-4ffe-8ae0-721eb2fe2ca3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:39.700188 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0619b3ad-3cf6-4ffe-8ae0-721eb2fe2ca3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:39.703655 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0619b3ad-3cf6-4ffe-8ae0-721eb2fe2ca3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:39.706975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0619b3ad-3cf6-4ffe-8ae0-721eb2fe2ca3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1670 microversion: 2.20 time: 0.264650 Jul 12 13:48:39.718225 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 433/873] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:39 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1670 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:39.973545 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e45806b2-8a79-4948-9b18-d5231c67b171 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:39.975418 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e45806b2-8a79-4948-9b18-d5231c67b171 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:39.998691 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e45806b2-8a79-4948-9b18-d5231c67b171 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:40.001380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e45806b2-8a79-4948-9b18-d5231c67b171 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:40.002998 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e45806b2-8a79-4948-9b18-d5231c67b171 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:40.003450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e45806b2-8a79-4948-9b18-d5231c67b171 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:40.266478 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-465c4f1c-c52b-4dbb-9a58-37621f6da06b tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "POST /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.201115 Jul 12 13:48:40.273248 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 441/874] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:48:39 2022] POST /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-volume_attachments => generated 194 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:48:40.405457 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e45806b2-8a79-4948-9b18-d5231c67b171 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:40.416408 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e45806b2-8a79-4948-9b18-d5231c67b171 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1673 microversion: 2.1 time: 0.450858 Jul 12 13:48:40.427189 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 434/875] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:39 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1673 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:40.728011 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f1d5ae0f-0a6a-4bec-bc98-3aa28d00a55f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:40.729763 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f1d5ae0f-0a6a-4bec-bc98-3aa28d00a55f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:40.738386 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1d5ae0f-0a6a-4bec-bc98-3aa28d00a55f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:40.739726 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1d5ae0f-0a6a-4bec-bc98-3aa28d00a55f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:40.740953 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1d5ae0f-0a6a-4bec-bc98-3aa28d00a55f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:40.741698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1d5ae0f-0a6a-4bec-bc98-3aa28d00a55f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:41.437943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b3998117-bc35-4267-b67c-c81862ad8673 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:41.439120 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b3998117-bc35-4267-b67c-c81862ad8673 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:41.448495 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b3998117-bc35-4267-b67c-c81862ad8673 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:41.449330 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b3998117-bc35-4267-b67c-c81862ad8673 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:41.450391 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b3998117-bc35-4267-b67c-c81862ad8673 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:41.450990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b3998117-bc35-4267-b67c-c81862ad8673 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:41.593930 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f1d5ae0f-0a6a-4bec-bc98-3aa28d00a55f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:41.604587 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f1d5ae0f-0a6a-4bec-bc98-3aa28d00a55f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:41.609624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f1d5ae0f-0a6a-4bec-bc98-3aa28d00a55f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:41.623551 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f1d5ae0f-0a6a-4bec-bc98-3aa28d00a55f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1670 microversion: 2.20 time: 0.901744 Jul 12 13:48:41.624457 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 442/876] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:40 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1670 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:41.634204 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b3998117-bc35-4267-b67c-c81862ad8673 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:41.644763 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b3998117-bc35-4267-b67c-c81862ad8673 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1673 microversion: 2.1 time: 0.214993 Jul 12 13:48:41.646601 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 435/877] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:41 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1673 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:42.643260 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-21dcd500-deba-418f-a305-8ec9f61eb0e2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:42.644467 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-21dcd500-deba-418f-a305-8ec9f61eb0e2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:42.652655 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21dcd500-deba-418f-a305-8ec9f61eb0e2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:42.658319 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21dcd500-deba-418f-a305-8ec9f61eb0e2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:42.659788 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21dcd500-deba-418f-a305-8ec9f61eb0e2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:42.661310 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b019ae6e-29d8-4249-bebd-4dae79126b7d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:42.661934 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b019ae6e-29d8-4249-bebd-4dae79126b7d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:42.662791 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21dcd500-deba-418f-a305-8ec9f61eb0e2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:42.669615 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b019ae6e-29d8-4249-bebd-4dae79126b7d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:42.670509 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b019ae6e-29d8-4249-bebd-4dae79126b7d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:42.671569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b019ae6e-29d8-4249-bebd-4dae79126b7d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:42.672217 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b019ae6e-29d8-4249-bebd-4dae79126b7d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:42.700732 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:42.758103 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b019ae6e-29d8-4249-bebd-4dae79126b7d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ad8ebe54a1d42eda9b23108f92a1d23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f431e3ab50a4133916f6175a2ef1b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:42.767340 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b019ae6e-29d8-4249-bebd-4dae79126b7d tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 200 len: 1605 microversion: 2.1 time: 0.109814 Jul 12 13:48:42.769311 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 436/878] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:42 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 1605 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:43.072388 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-d196353d-d8d8-4586-b6a4-09ec1afca5f9 req-240c3a0b-9b22-4908-b87c-c7a355da9cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a89058-e7f4-4e1a-8298-0fad022102c5", "name": "network-vif-deleted", "tag": "d5b61525-52a9-47b4-b3c4-b4220a1b2359"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:43.102246 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-d196353d-d8d8-4586-b6a4-09ec1afca5f9 req-240c3a0b-9b22-4908-b87c-c7a355da9cfe service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:43.102888 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-d196353d-d8d8-4586-b6a4-09ec1afca5f9 req-240c3a0b-9b22-4908-b87c-c7a355da9cfe service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:43.136314 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:43.140663 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-d196353d-d8d8-4586-b6a4-09ec1afca5f9 req-240c3a0b-9b22-4908-b87c-c7a355da9cfe service nova] Creating event network-vif-deleted:d5b61525-52a9-47b4-b3c4-b4220a1b2359 for instance a0a89058-e7f4-4e1a-8298-0fad022102c5 on hv-cinder-79797 Jul 12 13:48:43.155828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-d196353d-d8d8-4586-b6a4-09ec1afca5f9 req-240c3a0b-9b22-4908-b87c-c7a355da9cfe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087737 Jul 12 13:48:43.157576 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 437/879] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:43.311190 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-21dcd500-deba-418f-a305-8ec9f61eb0e2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:43.328865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-21dcd500-deba-418f-a305-8ec9f61eb0e2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:43.330303 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-21dcd500-deba-418f-a305-8ec9f61eb0e2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:43.331502 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-21dcd500-deba-418f-a305-8ec9f61eb0e2 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.692357 Jul 12 13:48:43.332191 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 443/880] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:42 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:43.786195 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0730cad7-4a3a-45fa-a830-07101e79e5e7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:43.787447 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0730cad7-4a3a-45fa-a830-07101e79e5e7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:43.805051 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0730cad7-4a3a-45fa-a830-07101e79e5e7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:43.805838 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0730cad7-4a3a-45fa-a830-07101e79e5e7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:43.806342 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0730cad7-4a3a-45fa-a830-07101e79e5e7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:43.807246 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0730cad7-4a3a-45fa-a830-07101e79e5e7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:43.837544 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-0730cad7-4a3a-45fa-a830-07101e79e5e7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] HTTP exception thrown: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0730cad7-4a3a-45fa-a830-07101e79e5e7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Request method failure captured: Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 HTTP/1.1 Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXoxhCc46UL_j1ts5vaVrgkT5bn-gAFQH8cj9TG7RHNxLBTWXG2_APR9_nZV025mEuypW9ejSvLgNoSZHSj1e8vgUaHF0Mx92g0hRtK4eMslFMrooNx4C9nDdxZuYql2BfSD3M54_pyY79qX4-eB2mjYu9i1GngOW_92-mQyrzFGmVo Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:48:43.873734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 2ad8ebe54a1d42eda9b23108f92a1d23 Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:43.875511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'a0a89058-e7f4-4e1a-8298-0fad022102c5'} Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:48:43.876547 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:43.878450 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:43.880663 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0730cad7-4a3a-45fa-a830-07101e79e5e7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Returning 404 to user: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:48:43.880663 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0730cad7-4a3a-45fa-a830-07101e79e5e7 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 404 len: 111 microversion: 2.1 time: 0.097327 Jul 12 13:48:43.880663 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 438/881] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:43 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:48:43.892174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f5b226ea-2414-4349-8da9-ea2c5e2a8fec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '.version_select at 0x7f3a1a45fdc0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:43.953517 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f5b226ea-2414-4349-8da9-ea2c5e2a8fec tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273323950" status: 202 len: 0 microversion: 2.1 time: 0.068376 Jul 12 13:48:43.954339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 444/882] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jul 12 13:48:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273323950 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:48:44.351960 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3c53dca9-d207-4cde-b75e-387ee98fdd31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:44.352745 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3c53dca9-d207-4cde-b75e-387ee98fdd31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:44.365007 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c53dca9-d207-4cde-b75e-387ee98fdd31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:44.368167 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c53dca9-d207-4cde-b75e-387ee98fdd31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:44.370578 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c53dca9-d207-4cde-b75e-387ee98fdd31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:44.371343 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3c53dca9-d207-4cde-b75e-387ee98fdd31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:44.661728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3c53dca9-d207-4cde-b75e-387ee98fdd31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:44.682386 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3c53dca9-d207-4cde-b75e-387ee98fdd31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:44.688761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3c53dca9-d207-4cde-b75e-387ee98fdd31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:44.699925 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3c53dca9-d207-4cde-b75e-387ee98fdd31 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.343291 Jul 12 13:48:44.710530 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 439/883] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:44 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:45.723910 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-369015b9-4af4-4a50-890a-3fd6a8c5c4e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:45.724809 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-369015b9-4af4-4a50-890a-3fd6a8c5c4e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:45.727025 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:45.761138 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-369015b9-4af4-4a50-890a-3fd6a8c5c4e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:45.769221 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-369015b9-4af4-4a50-890a-3fd6a8c5c4e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:45.773409 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-369015b9-4af4-4a50-890a-3fd6a8c5c4e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:45.775692 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-369015b9-4af4-4a50-890a-3fd6a8c5c4e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:46.452706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-369015b9-4af4-4a50-890a-3fd6a8c5c4e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:46.472460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-369015b9-4af4-4a50-890a-3fd6a8c5c4e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:46.474506 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-369015b9-4af4-4a50-890a-3fd6a8c5c4e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:46.477558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-369015b9-4af4-4a50-890a-3fd6a8c5c4e1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.760213 Jul 12 13:48:46.484375 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 445/884] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:45 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:47.485626 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d0f42ad8-ce0f-41e0-93c2-c8ed20776052 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:47.486503 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d0f42ad8-ce0f-41e0-93c2-c8ed20776052 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:47.501303 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0f42ad8-ce0f-41e0-93c2-c8ed20776052 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:47.502716 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0f42ad8-ce0f-41e0-93c2-c8ed20776052 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:47.504250 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0f42ad8-ce0f-41e0-93c2-c8ed20776052 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:47.505215 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d0f42ad8-ce0f-41e0-93c2-c8ed20776052 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:47.505401 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d1e61dad-c65e-47b6-a757-71b776ec23c7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:47.506399 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d1e61dad-c65e-47b6-a757-71b776ec23c7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:47.531277 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e61dad-c65e-47b6-a757-71b776ec23c7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:47.531900 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e61dad-c65e-47b6-a757-71b776ec23c7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:47.533119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e61dad-c65e-47b6-a757-71b776ec23c7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:47.533669 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d1e61dad-c65e-47b6-a757-71b776ec23c7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:47.709321 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-d0f42ad8-ce0f-41e0-93c2-c8ed20776052 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lazy-loading 'services' on Instance uuid e21b7c0d-991e-435a-a80a-0b5d2d7970da {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:48:47.947616 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d0f42ad8-ce0f-41e0-93c2-c8ed20776052 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-volume_attachments/b060835e-4665-4857-ae00-3a890c62db45" status: 202 len: 0 microversion: 2.1 time: 0.472045 Jul 12 13:48:47.954963 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 440/885] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:48:47 2022] DELETE /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-volume_attachments/b060835e-4665-4857-ae00-3a890c62db45 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:48:47.970787 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-503a7b35-8452-4b8b-8e5c-4ba577048713 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:47.971777 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-503a7b35-8452-4b8b-8e5c-4ba577048713 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:47.989341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d1e61dad-c65e-47b6-a757-71b776ec23c7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:48.017678 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-503a7b35-8452-4b8b-8e5c-4ba577048713 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:48.018557 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-503a7b35-8452-4b8b-8e5c-4ba577048713 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:48.023554 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-503a7b35-8452-4b8b-8e5c-4ba577048713 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:48.024444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-503a7b35-8452-4b8b-8e5c-4ba577048713 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:48.055335 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d1e61dad-c65e-47b6-a757-71b776ec23c7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:48.065349 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d1e61dad-c65e-47b6-a757-71b776ec23c7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:48.069934 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d1e61dad-c65e-47b6-a757-71b776ec23c7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.568373 Jul 12 13:48:48.073123 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 446/886] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:47 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:48.105542 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-28b4b177-c5ee-4e14-b60c-ec68fa696464 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:48.121604 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-28b4b177-c5ee-4e14-b60c-ec68fa696464 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:48.131438 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-503a7b35-8452-4b8b-8e5c-4ba577048713 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] HTTP exception thrown: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-503a7b35-8452-4b8b-8e5c-4ba577048713 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Request method failure captured: Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: DELETE /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 HTTP/1.1 Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXoxhCc46UL_j1ts5vaVrgkT5bn-gAFQH8cj9TG7RHNxLBTWXG2_APR9_nZV025mEuypW9ejSvLgNoSZHSj1e8vgUaHF0Mx92g0hRtK4eMslFMrooNx4C9nDdxZuYql2BfSD3M54_pyY79qX4-eB2mjYu9i1GngOW_92-mQyrzFGmVo Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:48:48.149145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 2ad8ebe54a1d42eda9b23108f92a1d23 Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:48.152564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'a0a89058-e7f4-4e1a-8298-0fad022102c5'} Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:48:48.154473 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:48.157943 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:48.163204 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28b4b177-c5ee-4e14-b60c-ec68fa696464 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:48.165680 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-503a7b35-8452-4b8b-8e5c-4ba577048713 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Returning 404 to user: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:48:48.166563 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28b4b177-c5ee-4e14-b60c-ec68fa696464 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:48.169408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28b4b177-c5ee-4e14-b60c-ec68fa696464 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:48.170135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-503a7b35-8452-4b8b-8e5c-4ba577048713 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 404 len: 111 microversion: 2.1 time: 0.211504 Jul 12 13:48:48.172089 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 441/887] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:48:47 2022] DELETE /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:48:48.173672 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-28b4b177-c5ee-4e14-b60c-ec68fa696464 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:48.196522 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-372b5940-b5f5-446a-b6ba-4dbbf6aa62d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:48.198949 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-372b5940-b5f5-446a-b6ba-4dbbf6aa62d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: a0a89058-e7f4-4e1a-8298-0fad022102c5] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:48.216044 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-372b5940-b5f5-446a-b6ba-4dbbf6aa62d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:48.217836 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-372b5940-b5f5-446a-b6ba-4dbbf6aa62d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:48.220797 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-372b5940-b5f5-446a-b6ba-4dbbf6aa62d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:48.222346 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-372b5940-b5f5-446a-b6ba-4dbbf6aa62d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:48.282507 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-372b5940-b5f5-446a-b6ba-4dbbf6aa62d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] HTTP exception thrown: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-372b5940-b5f5-446a-b6ba-4dbbf6aa62d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Request method failure captured: Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 HTTP/1.1 Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXoxhCc46UL_j1ts5vaVrgkT5bn-gAFQH8cj9TG7RHNxLBTWXG2_APR9_nZV025mEuypW9ejSvLgNoSZHSj1e8vgUaHF0Mx92g0hRtK4eMslFMrooNx4C9nDdxZuYql2BfSD3M54_pyY79qX4-eB2mjYu9i1GngOW_92-mQyrzFGmVo Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:48:48.288723 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 2ad8ebe54a1d42eda9b23108f92a1d23 Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:48.292107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'a0a89058-e7f4-4e1a-8298-0fad022102c5'} Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:48:48.293542 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. Jul 12 13:48:48.296459 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:48.301301 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-372b5940-b5f5-446a-b6ba-4dbbf6aa62d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Returning 404 to user: Instance a0a89058-e7f4-4e1a-8298-0fad022102c5 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:48:48.303190 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-372b5940-b5f5-446a-b6ba-4dbbf6aa62d9 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5" status: 404 len: 111 microversion: 2.1 time: 0.125748 Jul 12 13:48:48.304826 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 442/888] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:48 2022] GET /compute/v2.1/servers/a0a89058-e7f4-4e1a-8298-0fad022102c5 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:48:48.323906 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-28b4b177-c5ee-4e14-b60c-ec68fa696464 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.245930 Jul 12 13:48:48.341434 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 447/889] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:48:48 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-volume_attachments => generated 197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:49.120445 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d907484f-2b3e-47da-a208-91b075cc64b7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:49.121066 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d907484f-2b3e-47da-a208-91b075cc64b7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:49.148129 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d907484f-2b3e-47da-a208-91b075cc64b7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:49.152170 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d907484f-2b3e-47da-a208-91b075cc64b7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:49.157011 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d907484f-2b3e-47da-a208-91b075cc64b7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:49.157789 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d907484f-2b3e-47da-a208-91b075cc64b7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:49.369938 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ff39f2ba-3202-4c1e-93d8-0d33a42d083d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:49.372466 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ff39f2ba-3202-4c1e-93d8-0d33a42d083d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:49.410998 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ff39f2ba-3202-4c1e-93d8-0d33a42d083d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:49.411465 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ff39f2ba-3202-4c1e-93d8-0d33a42d083d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:49.418569 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ff39f2ba-3202-4c1e-93d8-0d33a42d083d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:49.419334 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ff39f2ba-3202-4c1e-93d8-0d33a42d083d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:49.571049 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ff39f2ba-3202-4c1e-93d8-0d33a42d083d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216710 Jul 12 13:48:49.578171 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 448/890] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:48:49 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:49.630449 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8f7f7847-6ad1-457d-a5ff-78668bdf9fa3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:49.631534 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8f7f7847-6ad1-457d-a5ff-78668bdf9fa3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:49.663357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f7f7847-6ad1-457d-a5ff-78668bdf9fa3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:49.669121 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f7f7847-6ad1-457d-a5ff-78668bdf9fa3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:49.672338 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f7f7847-6ad1-457d-a5ff-78668bdf9fa3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:49.676406 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8f7f7847-6ad1-457d-a5ff-78668bdf9fa3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:49.717078 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-8f7f7847-6ad1-457d-a5ff-78668bdf9fa3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] HTTP exception thrown: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8f7f7847-6ad1-457d-a5ff-78668bdf9fa3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Request method failure captured: Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 HTTP/1.1 Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXoxhCc46UL_j1ts5vaVrgkT5bn-gAFQH8cj9TG7RHNxLBTWXG2_APR9_nZV025mEuypW9ejSvLgNoSZHSj1e8vgUaHF0Mx92g0hRtK4eMslFMrooNx4C9nDdxZuYql2BfSD3M54_pyY79qX4-eB2mjYu9i1GngOW_92-mQyrzFGmVo Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:48:49.718755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: 2ad8ebe54a1d42eda9b23108f92a1d23 Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:48:49.720706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '56b0cff6-7efa-4a5b-bcfa-e9e435a77da9'} Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:48:49.721482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:48:49.722747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:48:49.723929 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8f7f7847-6ad1-457d-a5ff-78668bdf9fa3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Returning 404 to user: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:48:49.723929 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8f7f7847-6ad1-457d-a5ff-78668bdf9fa3 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "DELETE /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 404 len: 111 microversion: 2.1 time: 0.103160 Jul 12 13:48:49.730012 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 449/891] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:48:49 2022] DELETE /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:48:49.740086 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d907484f-2b3e-47da-a208-91b075cc64b7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:49.741426 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-793f2e21-f419-4e64-b282-fac5baa7ed98 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:49.742360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-793f2e21-f419-4e64-b282-fac5baa7ed98 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] [instance: 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:49.756997 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-793f2e21-f419-4e64-b282-fac5baa7ed98 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:49.758895 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d907484f-2b3e-47da-a208-91b075cc64b7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:49.759146 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-793f2e21-f419-4e64-b282-fac5baa7ed98 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:49.763762 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-793f2e21-f419-4e64-b282-fac5baa7ed98 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:49.767221 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-793f2e21-f419-4e64-b282-fac5baa7ed98 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:49.771271 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d907484f-2b3e-47da-a208-91b075cc64b7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:49.772812 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d907484f-2b3e-47da-a208-91b075cc64b7 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.675755 Jul 12 13:48:49.785488 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 443/892] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:49 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:49.809764 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-793f2e21-f419-4e64-b282-fac5baa7ed98 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] HTTP exception thrown: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-793f2e21-f419-4e64-b282-fac5baa7ed98 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Request method failure captured: Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 HTTP/1.1 Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXoxhCc46UL_j1ts5vaVrgkT5bn-gAFQH8cj9TG7RHNxLBTWXG2_APR9_nZV025mEuypW9ejSvLgNoSZHSj1e8vgUaHF0Mx92g0hRtK4eMslFMrooNx4C9nDdxZuYql2BfSD3M54_pyY79qX4-eB2mjYu9i1GngOW_92-mQyrzFGmVo Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:48:49.811294 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f431e3ab50a4133916f6175a2ef1b4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 5f431e3ab50a4133916f6175a2ef1b4f Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1126836276 Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: 2ad8ebe54a1d42eda9b23108f92a1d23 Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeTestJSON-1126836276-project Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:48:49.812777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '56b0cff6-7efa-4a5b-bcfa-e9e435a77da9'} Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:48:49.813515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. Jul 12 13:48:49.814744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:48:49.815812 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-793f2e21-f419-4e64-b282-fac5baa7ed98 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] Returning 404 to user: Instance 56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:48:49.815812 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-793f2e21-f419-4e64-b282-fac5baa7ed98 tempest-AttachVolumeTestJSON-1126836276 tempest-AttachVolumeTestJSON-1126836276-project] 10.222.0.52 "GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9" status: 404 len: 111 microversion: 2.1 time: 0.083422 Jul 12 13:48:49.836246 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 450/893] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:49 2022] GET /compute/v2.1/servers/56b0cff6-7efa-4a5b-bcfa-e9e435a77da9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:48:50.593322 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ca64e579-e0e9-429b-93f3-7b3f5337bf0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:50.595449 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ca64e579-e0e9-429b-93f3-7b3f5337bf0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:50.615928 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ca64e579-e0e9-429b-93f3-7b3f5337bf0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:50.623342 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ca64e579-e0e9-429b-93f3-7b3f5337bf0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:50.624609 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ca64e579-e0e9-429b-93f3-7b3f5337bf0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:50.626583 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ca64e579-e0e9-429b-93f3-7b3f5337bf0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:50.796450 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-db3db28d-9004-4407-811a-17d7e0f90e57 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:50.797438 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-db3db28d-9004-4407-811a-17d7e0f90e57 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:50.803839 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ca64e579-e0e9-429b-93f3-7b3f5337bf0d tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.209100 Jul 12 13:48:50.813865 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 444/894] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:48:50 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da/os-volume_attachments => generated 25 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:48:50.839042 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-db3db28d-9004-4407-811a-17d7e0f90e57 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:50.839506 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-db3db28d-9004-4407-811a-17d7e0f90e57 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:50.845026 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-db3db28d-9004-4407-811a-17d7e0f90e57 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:50.848283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-db3db28d-9004-4407-811a-17d7e0f90e57 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:50.949422 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0f360efe-b444-41ff-b142-211e3674e3dd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:50.950354 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0f360efe-b444-41ff-b142-211e3674e3dd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:50.999706 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0f360efe-b444-41ff-b142-211e3674e3dd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:51.002467 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0f360efe-b444-41ff-b142-211e3674e3dd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:51.007163 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0f360efe-b444-41ff-b142-211e3674e3dd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:51.009733 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0f360efe-b444-41ff-b142-211e3674e3dd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:51.152122 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0f360efe-b444-41ff-b142-211e3674e3dd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:48:51.478726 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0f360efe-b444-41ff-b142-211e3674e3dd tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 204 len: 0 microversion: 2.1 time: 0.531697 Jul 12 13:48:51.480052 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 445/895] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:48:50 2022] DELETE /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:48:51.514786 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d1c1f14b-a458-4001-9877-d6ec02a65643 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:51.516296 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d1c1f14b-a458-4001-9877-d6ec02a65643 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:51.541829 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1c1f14b-a458-4001-9877-d6ec02a65643 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:51.545172 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1c1f14b-a458-4001-9877-d6ec02a65643 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:51.547869 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1c1f14b-a458-4001-9877-d6ec02a65643 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:51.551177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1c1f14b-a458-4001-9877-d6ec02a65643 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:51.984872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d1c1f14b-a458-4001-9877-d6ec02a65643 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:52.001653 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d1c1f14b-a458-4001-9877-d6ec02a65643 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1681 microversion: 2.1 time: 0.508027 Jul 12 13:48:52.002544 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 446/896] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:51 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1681 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:52.053612 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-db3db28d-9004-4407-811a-17d7e0f90e57 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:52.068029 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-db3db28d-9004-4407-811a-17d7e0f90e57 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:52.069599 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-db3db28d-9004-4407-811a-17d7e0f90e57 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:52.078668 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-db3db28d-9004-4407-811a-17d7e0f90e57 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 1.289187 Jul 12 13:48:52.094770 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 451/897] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:50 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:48:53.023039 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-43f35aa7-5fdf-4664-90cc-8b50fd68eff2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:53.023679 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-43f35aa7-5fdf-4664-90cc-8b50fd68eff2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:53.047556 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-43f35aa7-5fdf-4664-90cc-8b50fd68eff2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:53.052424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-43f35aa7-5fdf-4664-90cc-8b50fd68eff2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:53.061436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-43f35aa7-5fdf-4664-90cc-8b50fd68eff2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:53.064334 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-43f35aa7-5fdf-4664-90cc-8b50fd68eff2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:53.107400 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d8ebbf58-427a-409f-b45a-86a93cf88f0e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:53.112809 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d8ebbf58-427a-409f-b45a-86a93cf88f0e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:53.150777 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d8ebbf58-427a-409f-b45a-86a93cf88f0e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:53.152639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d8ebbf58-427a-409f-b45a-86a93cf88f0e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:53.155151 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d8ebbf58-427a-409f-b45a-86a93cf88f0e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:53.157992 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d8ebbf58-427a-409f-b45a-86a93cf88f0e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:53.617630 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-43f35aa7-5fdf-4664-90cc-8b50fd68eff2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:53.651767 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-43f35aa7-5fdf-4664-90cc-8b50fd68eff2 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1681 microversion: 2.1 time: 0.635146 Jul 12 13:48:53.660168 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 447/898] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:53 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1681 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:53.953173 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d8ebbf58-427a-409f-b45a-86a93cf88f0e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:53.972435 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d8ebbf58-427a-409f-b45a-86a93cf88f0e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:53.980403 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d8ebbf58-427a-409f-b45a-86a93cf88f0e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:53.982014 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d8ebbf58-427a-409f-b45a-86a93cf88f0e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.883388 Jul 12 13:48:53.993667 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 452/899] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:53 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:54.676800 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0786ecde-68f3-4648-89d6-48630658d673 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:54.677434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0786ecde-68f3-4648-89d6-48630658d673 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:54.687152 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0786ecde-68f3-4648-89d6-48630658d673 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:54.687853 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0786ecde-68f3-4648-89d6-48630658d673 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:54.688332 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0786ecde-68f3-4648-89d6-48630658d673 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:54.688770 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0786ecde-68f3-4648-89d6-48630658d673 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:55.000897 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5f8d0b1e-370b-4a87-995b-3c99757010ec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:55.002501 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5f8d0b1e-370b-4a87-995b-3c99757010ec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:55.016679 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5f8d0b1e-370b-4a87-995b-3c99757010ec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:55.017345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5f8d0b1e-370b-4a87-995b-3c99757010ec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:55.022080 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5f8d0b1e-370b-4a87-995b-3c99757010ec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:55.022824 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5f8d0b1e-370b-4a87-995b-3c99757010ec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:55.587066 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0786ecde-68f3-4648-89d6-48630658d673 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:55.604273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0786ecde-68f3-4648-89d6-48630658d673 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1681 microversion: 2.1 time: 0.924424 Jul 12 13:48:55.606293 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 448/900] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:54 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1681 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:55.718869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5f8d0b1e-370b-4a87-995b-3c99757010ec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:55.730571 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5f8d0b1e-370b-4a87-995b-3c99757010ec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:55.732263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-5f8d0b1e-370b-4a87-995b-3c99757010ec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:55.733534 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5f8d0b1e-370b-4a87-995b-3c99757010ec tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.736956 Jul 12 13:48:55.750427 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 453/901] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:54 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:56.623697 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ba949d64-742a-4a59-af21-637604b0c8f9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:56.624474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ba949d64-742a-4a59-af21-637604b0c8f9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:56.640791 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ba949d64-742a-4a59-af21-637604b0c8f9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:56.641096 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ba949d64-742a-4a59-af21-637604b0c8f9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:56.644768 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ba949d64-742a-4a59-af21-637604b0c8f9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:56.645272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ba949d64-742a-4a59-af21-637604b0c8f9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:56.771968 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9bcd4c2d-0b53-46f8-ab0f-a4bcfd7da09c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:56.773537 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9bcd4c2d-0b53-46f8-ab0f-a4bcfd7da09c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:56.793853 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9bcd4c2d-0b53-46f8-ab0f-a4bcfd7da09c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:56.806695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9bcd4c2d-0b53-46f8-ab0f-a4bcfd7da09c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:56.807556 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9bcd4c2d-0b53-46f8-ab0f-a4bcfd7da09c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:56.808012 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9bcd4c2d-0b53-46f8-ab0f-a4bcfd7da09c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:57.324823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ba949d64-742a-4a59-af21-637604b0c8f9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a892b2511463404c818c63e870a23389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e88457b140443093476f9b6d9bcff4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:57.332774 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ba949d64-742a-4a59-af21-637604b0c8f9 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 200 len: 1613 microversion: 2.1 time: 0.713633 Jul 12 13:48:57.333319 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 449/902] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:56 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 1613 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:48:57.374688 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-e7ddb627-0d96-4c39-a962-92643c18bfd8 req-03e80bf1-a8fb-4060-b529-7835511ba900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e21b7c0d-991e-435a-a80a-0b5d2d7970da", "name": "network-vif-deleted", "tag": "7458e1e4-bcf0-49b3-873b-4abca58b5d9d"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:48:57.424336 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-e7ddb627-0d96-4c39-a962-92643c18bfd8 req-03e80bf1-a8fb-4060-b529-7835511ba900 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:57.427750 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-e7ddb627-0d96-4c39-a962-92643c18bfd8 req-03e80bf1-a8fb-4060-b529-7835511ba900 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:57.482047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-e7ddb627-0d96-4c39-a962-92643c18bfd8 req-03e80bf1-a8fb-4060-b529-7835511ba900 service nova] Creating event network-vif-deleted:7458e1e4-bcf0-49b3-873b-4abca58b5d9d for instance e21b7c0d-991e-435a-a80a-0b5d2d7970da on hv-cinder-79797 Jul 12 13:48:57.579936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-e7ddb627-0d96-4c39-a962-92643c18bfd8 req-03e80bf1-a8fb-4060-b529-7835511ba900 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245206 Jul 12 13:48:57.581030 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 450/903] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:48:57.627410 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9bcd4c2d-0b53-46f8-ab0f-a4bcfd7da09c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:57.640048 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9bcd4c2d-0b53-46f8-ab0f-a4bcfd7da09c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:57.645156 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-9bcd4c2d-0b53-46f8-ab0f-a4bcfd7da09c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:57.648365 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9bcd4c2d-0b53-46f8-ab0f-a4bcfd7da09c tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.880471 Jul 12 13:48:57.682790 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 454/904] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:56 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:48:58.352979 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0dc30197-0dcf-4c40-9e9c-37def7cb5d53 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:58.354058 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0dc30197-0dcf-4c40-9e9c-37def7cb5d53 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:58.375564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0dc30197-0dcf-4c40-9e9c-37def7cb5d53 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:58.376019 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0dc30197-0dcf-4c40-9e9c-37def7cb5d53 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:58.376820 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0dc30197-0dcf-4c40-9e9c-37def7cb5d53 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:58.377514 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0dc30197-0dcf-4c40-9e9c-37def7cb5d53 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:58.425936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-0dc30197-0dcf-4c40-9e9c-37def7cb5d53 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0dc30197-0dcf-4c40-9e9c-37def7cb5d53 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da HTTP/1.1 Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:48:58.430828 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:48:58.432635 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'e21b7c0d-991e-435a-a80a-0b5d2d7970da'} Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:48:58.433529 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:48:58.435134 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:48:58.437172 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0dc30197-0dcf-4c40-9e9c-37def7cb5d53 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:48:58.440819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0dc30197-0dcf-4c40-9e9c-37def7cb5d53 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 404 len: 111 microversion: 2.1 time: 0.093071 Jul 12 13:48:58.447520 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 451/905] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:48:58 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:48:58.456340 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d57bf77a-fefd-4698-9fbd-f893307f2808 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '.version_select at 0x7f3a1a553d30>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:58.498955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d57bf77a-fefd-4698-9fbd-f893307f2808 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679654482" status: 202 len: 0 microversion: 2.1 time: 0.046357 Jul 12 13:48:58.499638 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 455/906] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Jul 12 13:48:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679654482 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:48:58.671990 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ad6bf170-fdc0-4db1-aec4-b60622506bd3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:48:58.672668 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ad6bf170-fdc0-4db1-aec4-b60622506bd3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:48:58.693505 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ad6bf170-fdc0-4db1-aec4-b60622506bd3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:58.693941 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ad6bf170-fdc0-4db1-aec4-b60622506bd3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:58.694987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ad6bf170-fdc0-4db1-aec4-b60622506bd3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:48:58.695594 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ad6bf170-fdc0-4db1-aec4-b60622506bd3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:48:59.141915 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ad6bf170-fdc0-4db1-aec4-b60622506bd3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:59.160652 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ad6bf170-fdc0-4db1-aec4-b60622506bd3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:59.171499 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ad6bf170-fdc0-4db1-aec4-b60622506bd3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:48:59.172973 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ad6bf170-fdc0-4db1-aec4-b60622506bd3 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.505104 Jul 12 13:48:59.186201 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 452/907] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:48:58 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:00.192857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7f355a07-e82f-4d6c-b656-6860cdda639e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:00.193481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7f355a07-e82f-4d6c-b656-6860cdda639e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:00.202685 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7f355a07-e82f-4d6c-b656-6860cdda639e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:00.203338 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7f355a07-e82f-4d6c-b656-6860cdda639e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:00.204130 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7f355a07-e82f-4d6c-b656-6860cdda639e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:00.204570 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7f355a07-e82f-4d6c-b656-6860cdda639e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:01.552867 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7f355a07-e82f-4d6c-b656-6860cdda639e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:01.563694 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7f355a07-e82f-4d6c-b656-6860cdda639e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:01.581050 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7f355a07-e82f-4d6c-b656-6860cdda639e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:01.583377 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7f355a07-e82f-4d6c-b656-6860cdda639e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 1.394596 Jul 12 13:49:01.598929 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 456/908] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:00 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:02.606756 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d72656a9-b2ef-49b5-a6ec-4ed71d40f03e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:02.607374 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d72656a9-b2ef-49b5-a6ec-4ed71d40f03e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:02.643446 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d72656a9-b2ef-49b5-a6ec-4ed71d40f03e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:02.646920 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d72656a9-b2ef-49b5-a6ec-4ed71d40f03e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:02.647771 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d72656a9-b2ef-49b5-a6ec-4ed71d40f03e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:02.648215 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d72656a9-b2ef-49b5-a6ec-4ed71d40f03e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:03.083170 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d72656a9-b2ef-49b5-a6ec-4ed71d40f03e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:03.124763 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d72656a9-b2ef-49b5-a6ec-4ed71d40f03e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:03.139788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d72656a9-b2ef-49b5-a6ec-4ed71d40f03e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:03.143561 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d72656a9-b2ef-49b5-a6ec-4ed71d40f03e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.541253 Jul 12 13:49:03.146873 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 453/909] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:02 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:03.175300 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2224a4f7-bdd0-4725-adf5-9a0d56bd3930 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:03.175879 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2224a4f7-bdd0-4725-adf5-9a0d56bd3930 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:03.184073 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2224a4f7-bdd0-4725-adf5-9a0d56bd3930 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:03.184527 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2224a4f7-bdd0-4725-adf5-9a0d56bd3930 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:03.185312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2224a4f7-bdd0-4725-adf5-9a0d56bd3930 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:03.185748 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2224a4f7-bdd0-4725-adf5-9a0d56bd3930 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:03.232770 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-2224a4f7-bdd0-4725-adf5-9a0d56bd3930 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2224a4f7-bdd0-4725-adf5-9a0d56bd3930 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da HTTP/1.1 Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:03.234698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:49:03.236376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'e21b7c0d-991e-435a-a80a-0b5d2d7970da'} Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:03.237228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:49:03.238701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:03.241203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2224a4f7-bdd0-4725-adf5-9a0d56bd3930 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:03.242367 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2224a4f7-bdd0-4725-adf5-9a0d56bd3930 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 404 len: 111 microversion: 2.1 time: 0.071009 Jul 12 13:49:03.249920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 457/910] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:49:03 2022] DELETE /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:03.259897 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b6c6f566-bbd4-4877-97b3-9eec7d05faf4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:03.260733 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b6c6f566-bbd4-4877-97b3-9eec7d05faf4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: e21b7c0d-991e-435a-a80a-0b5d2d7970da] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:03.305239 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6c6f566-bbd4-4877-97b3-9eec7d05faf4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:03.308424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6c6f566-bbd4-4877-97b3-9eec7d05faf4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:03.321188 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6c6f566-bbd4-4877-97b3-9eec7d05faf4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:03.326385 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6c6f566-bbd4-4877-97b3-9eec7d05faf4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:03.362758 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-b6c6f566-bbd4-4877-97b3-9eec7d05faf4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b6c6f566-bbd4-4877-97b3-9eec7d05faf4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da HTTP/1.1 Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:49:03.390999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:49:03.392872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'e21b7c0d-991e-435a-a80a-0b5d2d7970da'} Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:03.393728 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. Jul 12 13:49:03.395684 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:03.398645 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b6c6f566-bbd4-4877-97b3-9eec7d05faf4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance e21b7c0d-991e-435a-a80a-0b5d2d7970da could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:03.398645 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b6c6f566-bbd4-4877-97b3-9eec7d05faf4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da" status: 404 len: 111 microversion: 2.1 time: 0.139347 Jul 12 13:49:03.398645 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 454/911] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:03 2022] GET /compute/v2.1/servers/e21b7c0d-991e-435a-a80a-0b5d2d7970da => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:04.163439 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-65cfcf93-ce86-490f-98b2-ef99b34ad3c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:04.164338 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-65cfcf93-ce86-490f-98b2-ef99b34ad3c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:04.177588 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-65cfcf93-ce86-490f-98b2-ef99b34ad3c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:04.183593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-65cfcf93-ce86-490f-98b2-ef99b34ad3c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:04.186144 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-65cfcf93-ce86-490f-98b2-ef99b34ad3c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:04.186144 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-65cfcf93-ce86-490f-98b2-ef99b34ad3c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:04.378412 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-dda4396a-3892-4cde-8322-b5d991942e6c tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Action: 'create', calling method: .version_select at 0x7f3a15cd7b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1995291148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR1svSG13ISA0pLrtuFfpgg2TWrTEPy4T9pWMXZo2dC0hsU2HmRd0lmqVb1iicXaUlS85yzjnZjGbWI50e/nbNnEnqK4Fdl2ec9Zx+Ai2E5GmXYmKpXGeXwkmS74E5qtg=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:04.416792 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-dda4396a-3892-4cde-8322-b5d991942e6c tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Getting quotas for project 70562708174846e9bb7b1b128a629a98. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:49:04.429184 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-dda4396a-3892-4cde-8322-b5d991942e6c tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Getting quotas for user ab68f09ccf4d4ac9901d4ed792b551c0 and project 70562708174846e9bb7b1b128a629a98. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:49:04.501464 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-dda4396a-3892-4cde-8322-b5d991942e6c tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.124289 Jul 12 13:49:04.514483 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 455/912] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jul 12 13:49:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:49:04.529750 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-65cfcf93-ce86-490f-98b2-ef99b34ad3c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:04.538417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-65cfcf93-ce86-490f-98b2-ef99b34ad3c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:04.541615 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-65cfcf93-ce86-490f-98b2-ef99b34ad3c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:04.543980 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-65cfcf93-ce86-490f-98b2-ef99b34ad3c0 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.384291 Jul 12 13:49:04.545220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 458/913] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:04 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:04.650240 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-843594577", "imageRef": "1c02e226-1e23-4051-a240-415b0556fdea", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1995291148", "networks": [{"uuid": "131d3ff9-bfa5-4ef2-ace9-a0dcb38034b7"}]}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:04.768325 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-09b09d09-6b60-4694-9f6f-ba7a1b834e74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:04.772510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-09b09d09-6b60-4694-9f6f-ba7a1b834e74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:04.791748 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09b09d09-6b60-4694-9f6f-ba7a1b834e74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:04.794265 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09b09d09-6b60-4694-9f6f-ba7a1b834e74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:04.795382 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09b09d09-6b60-4694-9f6f-ba7a1b834e74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:04.796203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09b09d09-6b60-4694-9f6f-ba7a1b834e74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:04.804667 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.network.neutron [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] validate_networks() for [('131d3ff9-bfa5-4ef2-ace9-a0dcb38034b7', None, None, None, None, None)] {{(pid=124465) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:49:04.841481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-09b09d09-6b60-4694-9f6f-ba7a1b834e74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-09b09d09-6b60-4694-9f6f-ba7a1b834e74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 HTTP/1.1 Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:04.851797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:49:04.853863 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '84876f50-f017-42db-8784-05787e987508'} Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:04.854743 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:49:04.855944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:04.858315 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-09b09d09-6b60-4694-9f6f-ba7a1b834e74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:04.859384 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-09b09d09-6b60-4694-9f6f-ba7a1b834e74 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 404 len: 111 microversion: 2.1 time: 0.096590 Jul 12 13:49:04.861647 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 459/914] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:49:04 2022] DELETE /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:04.886757 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6e330e1c-55ef-4cc8-bb7d-6295869750eb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:04.887394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6e330e1c-55ef-4cc8-bb7d-6295869750eb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 84876f50-f017-42db-8784-05787e987508] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:04.894067 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e330e1c-55ef-4cc8-bb7d-6295869750eb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:04.894808 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e330e1c-55ef-4cc8-bb7d-6295869750eb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:04.895742 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e330e1c-55ef-4cc8-bb7d-6295869750eb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:04.896335 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6e330e1c-55ef-4cc8-bb7d-6295869750eb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:04.914738 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-6e330e1c-55ef-4cc8-bb7d-6295869750eb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6e330e1c-55ef-4cc8-bb7d-6295869750eb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 HTTP/1.1 Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:04.917946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:49:04.919582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '84876f50-f017-42db-8784-05787e987508'} Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:04.920468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. Jul 12 13:49:04.921829 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:04.924913 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6e330e1c-55ef-4cc8-bb7d-6295869750eb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance 84876f50-f017-42db-8784-05787e987508 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:04.926167 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6e330e1c-55ef-4cc8-bb7d-6295869750eb tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508" status: 404 len: 111 microversion: 2.1 time: 0.060447 Jul 12 13:49:04.927216 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 460/915] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:04 2022] GET /compute/v2.1/servers/84876f50-f017-42db-8784-05787e987508 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:04.936571 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-58ecd53f-1e5a-4538-b333-c1c775648b22 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a1a45f1f0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:05.052536 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-58ecd53f-1e5a-4538-b333-c1c775648b22 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/935ebe53-38b9-427e-8b48-ed75745b217c" status: 200 len: 350 microversion: 2.1 time: 0.123565 Jul 12 13:49:05.053665 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 461/916] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:49:04 2022] GET /compute/v2.1/os-volumes/935ebe53-38b9-427e-8b48-ed75745b217c => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:05.061076 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-375844e2-db00-4d2f-ade0-6341a72923c8 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:05.061622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-375844e2-db00-4d2f-ade0-6341a72923c8 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:05.075913 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-375844e2-db00-4d2f-ade0-6341a72923c8 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:05.076946 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-375844e2-db00-4d2f-ade0-6341a72923c8 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:05.078894 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-375844e2-db00-4d2f-ade0-6341a72923c8 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:05.080568 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-375844e2-db00-4d2f-ade0-6341a72923c8 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:05.127851 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-375844e2-db00-4d2f-ade0-6341a72923c8 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-375844e2-db00-4d2f-ade0-6341a72923c8 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 HTTP/1.1 Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:05.129658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:49:05.131115 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '95cd2ee8-a4fd-4ff1-90ac-a475974c4f98'} Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:05.131904 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:49:05.133133 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:05.140604 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-375844e2-db00-4d2f-ade0-6341a72923c8 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:05.150603 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-375844e2-db00-4d2f-ade0-6341a72923c8 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 404 len: 111 microversion: 2.1 time: 0.087472 Jul 12 13:49:05.151320 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 462/917] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:49:05 2022] DELETE /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:05.164020 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-03e93577-7af1-4cc7-b819-c03023d34cd4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:05.165170 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-03e93577-7af1-4cc7-b819-c03023d34cd4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:05.173340 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-03e93577-7af1-4cc7-b819-c03023d34cd4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:05.174283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-03e93577-7af1-4cc7-b819-c03023d34cd4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:05.175320 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-03e93577-7af1-4cc7-b819-c03023d34cd4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:05.176011 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-03e93577-7af1-4cc7-b819-c03023d34cd4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:05.207926 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-03e93577-7af1-4cc7-b819-c03023d34cd4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-03e93577-7af1-4cc7-b819-c03023d34cd4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 HTTP/1.1 Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:05.224081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:49:05.225624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '95cd2ee8-a4fd-4ff1-90ac-a475974c4f98'} Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:05.226424 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. Jul 12 13:49:05.227648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:05.228804 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-03e93577-7af1-4cc7-b819-c03023d34cd4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance 95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:05.228804 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-03e93577-7af1-4cc7-b819-c03023d34cd4 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98" status: 404 len: 111 microversion: 2.1 time: 0.069384 Jul 12 13:49:05.253930 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 463/918] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:05 2022] GET /compute/v2.1/servers/95cd2ee8-a4fd-4ff1-90ac-a475974c4f98 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:49:05.595234 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b30755ab-23fa-49c4-8904-a36aa05c6a25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:05.598891 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b30755ab-23fa-49c4-8904-a36aa05c6a25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:05.647670 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b30755ab-23fa-49c4-8904-a36aa05c6a25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:05.656082 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b30755ab-23fa-49c4-8904-a36aa05c6a25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:05.657180 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b30755ab-23fa-49c4-8904-a36aa05c6a25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:05.658313 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b30755ab-23fa-49c4-8904-a36aa05c6a25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:06.017937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b30755ab-23fa-49c4-8904-a36aa05c6a25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:06.028716 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b30755ab-23fa-49c4-8904-a36aa05c6a25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:06.030694 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b30755ab-23fa-49c4-8904-a36aa05c6a25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:06.036569 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b30755ab-23fa-49c4-8904-a36aa05c6a25 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.473684 Jul 12 13:49:06.037488 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 464/919] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:05 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:06.452384 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Flavor limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:49:06.452997 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Image limits 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:49:06.453261 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Flavor pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:49:06.453667 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Image pref 0:0:0 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:49:06.454283 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.virt.hardware [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124465) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:49:06.472729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:06.478499 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:06.479847 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:06.483941 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:06.530459 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3f182779-0b0f-4cc6-81b0-8e84353fd318 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:06.531038 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3f182779-0b0f-4cc6-81b0-8e84353fd318 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:06.531480 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Getting quotas for project 70562708174846e9bb7b1b128a629a98. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:49:06.539516 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Getting quotas for user ab68f09ccf4d4ac9901d4ed792b551c0 and project 70562708174846e9bb7b1b128a629a98. Resources: {'cores', 'ram', 'instances'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:49:06.552394 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f182779-0b0f-4cc6-81b0-8e84353fd318 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:06.552846 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f182779-0b0f-4cc6-81b0-8e84353fd318 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:06.553682 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f182779-0b0f-4cc6-81b0-8e84353fd318 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:06.554088 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3f182779-0b0f-4cc6-81b0-8e84353fd318 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:06.577429 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Going to run 1 instances... {{(pid=124465) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:49:06.579814 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c02e226-1e23-4051-a240-415b0556fdea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124465) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:49:06.589599 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-3f182779-0b0f-4cc6-81b0-8e84353fd318 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3f182779-0b0f-4cc6-81b0-8e84353fd318 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 HTTP/1.1 Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:06.591550 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:49:06.593116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'dedddab8-9a74-4ae7-b88c-9320b24d5440'} Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:06.594019 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:49:06.595464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:06.597772 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3f182779-0b0f-4cc6-81b0-8e84353fd318 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:06.597772 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3f182779-0b0f-4cc6-81b0-8e84353fd318 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 404 len: 111 microversion: 2.1 time: 0.066254 Jul 12 13:49:06.609018 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 465/920] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:49:06 2022] DELETE /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:06.614434 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f32d8b56-c9d7-42ab-a62d-8daa3ee6ff09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:06.615042 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f32d8b56-c9d7-42ab-a62d-8daa3ee6ff09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] [instance: dedddab8-9a74-4ae7-b88c-9320b24d5440] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:06.630122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f32d8b56-c9d7-42ab-a62d-8daa3ee6ff09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:06.630581 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f32d8b56-c9d7-42ab-a62d-8daa3ee6ff09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:06.632557 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f32d8b56-c9d7-42ab-a62d-8daa3ee6ff09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:06.638659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f32d8b56-c9d7-42ab-a62d-8daa3ee6ff09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:06.678319 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-f32d8b56-c9d7-42ab-a62d-8daa3ee6ff09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] HTTP exception thrown: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f32d8b56-c9d7-42ab-a62d-8daa3ee6ff09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Request method failure captured: Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 HTTP/1.1 Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo4mpHZMVwsyQOw42iw2xc4piITmmDHO55WeYmIzzygAUs7o_g1hjaK4pB-7UYaVb6gRkfDMbj6Wsv1zFLstsB6Q8nvqnJrMY3Aro4NNziTxPP4eJGR1iqZSKBe9_Z9_G4rn-8x24LvSZyx1eBlG4UfICBMlNtPkPdJ_79A2qulz9Y Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:06.682165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4e88457b140443093476f9b6d9bcff4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: c4e88457b140443093476f9b6d9bcff4 Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2011516601 Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: a892b2511463404c818c63e870a23389 Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeNegativeTest-2011516601-project Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:49:06.683811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'dedddab8-9a74-4ae7-b88c-9320b24d5440'} Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:06.684864 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. Jul 12 13:49:06.686353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:06.690223 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f32d8b56-c9d7-42ab-a62d-8daa3ee6ff09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] Returning 404 to user: Instance dedddab8-9a74-4ae7-b88c-9320b24d5440 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:06.692760 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f32d8b56-c9d7-42ab-a62d-8daa3ee6ff09 tempest-AttachVolumeNegativeTest-2011516601 tempest-AttachVolumeNegativeTest-2011516601-project] 10.222.0.52 "GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440" status: 404 len: 111 microversion: 2.1 time: 0.082172 Jul 12 13:49:06.693717 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-450a1517-7194-4129-ae5e-6cf51f8d5d8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.050291 Jul 12 13:49:06.699386 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 456/921] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:49:06.702701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 466/922] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:06 2022] GET /compute/v2.1/servers/dedddab8-9a74-4ae7-b88c-9320b24d5440 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:06.734812 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b8a53b00-bfdb-455a-b144-03d3ac1fe94c tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:06.735424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b8a53b00-bfdb-455a-b144-03d3ac1fe94c tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:06.832175 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5898729e-b62c-4f28-99ed-e2708fc0a7a4 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a1a553e50>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:06.908381 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b8a53b00-bfdb-455a-b144-03d3ac1fe94c tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:06.916352 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b8a53b00-bfdb-455a-b144-03d3ac1fe94c tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1258 microversion: 2.1 time: 0.202343 Jul 12 13:49:06.926305 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5898729e-b62c-4f28-99ed-e2708fc0a7a4 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/fb2b2f1b-cbca-45b0-8482-9bc57042ff78" status: 200 len: 350 microversion: 2.1 time: 0.097884 Jul 12 13:49:06.927183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 467/923] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:49:06 2022] GET /compute/v2.1/os-volumes/fb2b2f1b-cbca-45b0-8482-9bc57042ff78 => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:49:06.930951 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 457/924] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:06 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1258 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:07.057344 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-21c1823c-bce5-454c-bc30-dd119fdefff8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:07.057982 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-21c1823c-bce5-454c-bc30-dd119fdefff8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:07.070400 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21c1823c-bce5-454c-bc30-dd119fdefff8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:07.070859 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21c1823c-bce5-454c-bc30-dd119fdefff8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:07.073251 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21c1823c-bce5-454c-bc30-dd119fdefff8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:07.073696 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-21c1823c-bce5-454c-bc30-dd119fdefff8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:07.397765 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-21c1823c-bce5-454c-bc30-dd119fdefff8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:07.406820 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-21c1823c-bce5-454c-bc30-dd119fdefff8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:07.408549 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-21c1823c-bce5-454c-bc30-dd119fdefff8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:07.409760 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-21c1823c-bce5-454c-bc30-dd119fdefff8 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.358111 Jul 12 13:49:07.416150 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 468/925] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:07 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:07.949019 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-345c8c6a-f47f-4854-937f-af16b3d5dab2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:07.949642 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-345c8c6a-f47f-4854-937f-af16b3d5dab2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:07.958312 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-345c8c6a-f47f-4854-937f-af16b3d5dab2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:07.959733 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-345c8c6a-f47f-4854-937f-af16b3d5dab2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:07.960735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-345c8c6a-f47f-4854-937f-af16b3d5dab2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:07.961789 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-345c8c6a-f47f-4854-937f-af16b3d5dab2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:08.412399 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-345c8c6a-f47f-4854-937f-af16b3d5dab2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:08.415212 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:08.430475 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-345c8c6a-f47f-4854-937f-af16b3d5dab2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1310 microversion: 2.1 time: 0.483130 Jul 12 13:49:08.432140 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-dc1b95ab-72e0-4da1-b328-a288dde4a711 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:08.432797 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 458/926] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:07 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1310 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:08.434453 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-dc1b95ab-72e0-4da1-b328-a288dde4a711 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:08.449158 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dc1b95ab-72e0-4da1-b328-a288dde4a711 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:08.450036 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dc1b95ab-72e0-4da1-b328-a288dde4a711 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:08.456430 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dc1b95ab-72e0-4da1-b328-a288dde4a711 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:08.472816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-dc1b95ab-72e0-4da1-b328-a288dde4a711 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:08.503223 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-699515be-e03d-4f88-a2c1-4002aec27928 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a15d6d790>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:08.617530 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-699515be-e03d-4f88-a2c1-4002aec27928 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/43cfedc7-aaf2-4f6f-8798-729eeb2a6b10" status: 200 len: 351 microversion: 2.1 time: 0.118142 Jul 12 13:49:08.618912 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 459/927] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:49:08 2022] GET /compute/v2.1/os-volumes/43cfedc7-aaf2-4f6f-8798-729eeb2a6b10 => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:49:08.632481 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5ff51a93-6f5b-4e5a-acf1-dfb386a0296d tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a15cd7550>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:08.786804 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5ff51a93-6f5b-4e5a-acf1-dfb386a0296d tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.159856 Jul 12 13:49:08.795072 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 460/928] 10.222.0.52 () {58 vars in 1133 bytes} [Tue Jul 12 13:49:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:08.800044 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-be4c890e-d04e-4eaf-b8c4-3f119f11758c tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a15c881f0>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:08.929140 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-be4c890e-d04e-4eaf-b8c4-3f119f11758c tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.132774 Jul 12 13:49:08.929714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 461/929] 10.222.0.52 () {58 vars in 1148 bytes} [Tue Jul 12 13:49:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:08.943286 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e2065780-a8c7-4b82-9a4e-02946d478aa3 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a15af10d0>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:09.070294 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e2065780-a8c7-4b82-9a4e-02946d478aa3 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.130779 Jul 12 13:49:09.072859 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 462/930] 10.222.0.52 () {58 vars in 1133 bytes} [Tue Jul 12 13:49:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:49:09.084074 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-65459f84-57c3-4cdd-a9fe-639569bcba72 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a15ca7e50>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:09.255084 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-65459f84-57c3-4cdd-a9fe-639569bcba72 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.175182 Jul 12 13:49:09.255689 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 463/931] 10.222.0.52 () {58 vars in 1166 bytes} [Tue Jul 12 13:49:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:49:09.265910 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-dc1b95ab-72e0-4da1-b328-a288dde4a711 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:09.275184 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a5f494f8-fa38-4c82-8144-18303cf8b2a1 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a15d49280>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:09.284446 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-dc1b95ab-72e0-4da1-b328-a288dde4a711 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:09.294884 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-dc1b95ab-72e0-4da1-b328-a288dde4a711 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:09.296898 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-dc1b95ab-72e0-4da1-b328-a288dde4a711 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.872102 Jul 12 13:49:09.314122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 469/932] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:08 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:09.448411 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-33b05db8-b950-4de2-af2a-3f8bfb30e844 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:09.449753 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-33b05db8-b950-4de2-af2a-3f8bfb30e844 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:09.468584 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33b05db8-b950-4de2-af2a-3f8bfb30e844 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:09.469304 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33b05db8-b950-4de2-af2a-3f8bfb30e844 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:09.470427 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33b05db8-b950-4de2-af2a-3f8bfb30e844 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:09.471108 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-33b05db8-b950-4de2-af2a-3f8bfb30e844 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:09.476029 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=100 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:09.536843 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a5f494f8-fa38-4c82-8144-18303cf8b2a1 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.269484 Jul 12 13:49:09.537645 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 464/933] 10.222.0.52 () {58 vars in 1169 bytes} [Tue Jul 12 13:49:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:09.552648 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b4c22286-d0b4-4886-a6ef-77550aa6c359 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a15ca7820>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:09.721698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-33b05db8-b950-4de2-af2a-3f8bfb30e844 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:09.724037 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b4c22286-d0b4-4886-a6ef-77550aa6c359 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.175624 Jul 12 13:49:09.725301 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 465/934] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Jul 12 13:49:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:09.737015 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-33b05db8-b950-4de2-af2a-3f8bfb30e844 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1316 microversion: 2.1 time: 0.292435 Jul 12 13:49:09.739069 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-962cead8-85f0-4d7a-b94b-8bb440474091 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a160c8280>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:09.748053 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 470/935] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:09 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:49:09.989866 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-962cead8-85f0-4d7a-b94b-8bb440474091 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.253119 Jul 12 13:49:09.999404 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 466/936] 10.222.0.52 () {58 vars in 1187 bytes} [Tue Jul 12 13:49:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:49:10.014858 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4b7a9a5b-432f-45c6-bebc-f6619e3f6b78 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] Calling method '.version_select at 0x7f3a1652fdc0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:10.241695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4b7a9a5b-432f-45c6-bebc-f6619e3f6b78 tempest-VolumesTestJSON-1973489242 tempest-VolumesTestJSON-1973489242-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.232204 Jul 12 13:49:10.242947 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 471/937] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Jul 12 13:49:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:10.320102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-9749a803-97c3-4758-85ca-7e80165f5e6f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:10.320713 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-9749a803-97c3-4758-85ca-7e80165f5e6f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:10.340987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:10.342650 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9749a803-97c3-4758-85ca-7e80165f5e6f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:10.343107 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9749a803-97c3-4758-85ca-7e80165f5e6f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:10.351495 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9749a803-97c3-4758-85ca-7e80165f5e6f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:10.352029 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-9749a803-97c3-4758-85ca-7e80165f5e6f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:10.761974 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-09857465-ef65-43de-b764-0bcb0008adb4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:10.762755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-09857465-ef65-43de-b764-0bcb0008adb4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:10.771069 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09857465-ef65-43de-b764-0bcb0008adb4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:10.771723 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09857465-ef65-43de-b764-0bcb0008adb4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:10.772638 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09857465-ef65-43de-b764-0bcb0008adb4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:10.773297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-09857465-ef65-43de-b764-0bcb0008adb4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:10.862017 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-9749a803-97c3-4758-85ca-7e80165f5e6f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:10.872629 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-9749a803-97c3-4758-85ca-7e80165f5e6f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:10.888710 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-9749a803-97c3-4758-85ca-7e80165f5e6f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:10.892474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-9749a803-97c3-4758-85ca-7e80165f5e6f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.576173 Jul 12 13:49:10.927784 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 467/938] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:10 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:11.498748 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-09857465-ef65-43de-b764-0bcb0008adb4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:11.507292 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-09857465-ef65-43de-b764-0bcb0008adb4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.751592 Jul 12 13:49:11.526186 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 472/939] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:10 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:11.915994 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-93ba3e03-874c-41d8-93b5-3363a0f38a3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:11.917840 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-93ba3e03-874c-41d8-93b5-3363a0f38a3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:11.926658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93ba3e03-874c-41d8-93b5-3363a0f38a3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:11.939135 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93ba3e03-874c-41d8-93b5-3363a0f38a3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:11.939135 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93ba3e03-874c-41d8-93b5-3363a0f38a3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:11.939135 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-93ba3e03-874c-41d8-93b5-3363a0f38a3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:12.223456 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-30ced9ed-5bba-4c2a-b8eb-f18fca113f69 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Action: 'create', calling method: .version_select at 0x7f3a15bd5d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-2098390379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYVrhML18/oeT297L9BbxSfwtnWO+zqpMEsbKTmUrZPaxPN4T4igyNCZo5+d4wCGBc622HQi4rOgaHQrLWIROfrqwYO11wB57XtWQNk5ofBWPB2YHPssoreZQnUZUUCJw=="}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:12.248170 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-30ced9ed-5bba-4c2a-b8eb-f18fca113f69 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Getting quotas for project dc981a893df54f079e63399ace23ef1c. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:49:12.283564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.quota [None req-30ced9ed-5bba-4c2a-b8eb-f18fca113f69 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Getting quotas for user 3dd90f756d724016b60c80e9c78cce41 and project dc981a893df54f079e63399ace23ef1c. Resources: {'key_pairs'} {{(pid=124465) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:49:12.323592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-30ced9ed-5bba-4c2a-b8eb-f18fca113f69 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.528067 Jul 12 13:49:12.325665 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 468/940] 10.222.0.52 () {60 vars in 1158 bytes} [Tue Jul 12 13:49:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:49:12.534662 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-51ef6f7b-0780-4b52-9695-f792cc75a490 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:12.535652 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-51ef6f7b-0780-4b52-9695-f792cc75a490 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:12.554969 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-51ef6f7b-0780-4b52-9695-f792cc75a490 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:12.558634 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-51ef6f7b-0780-4b52-9695-f792cc75a490 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:12.562726 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-51ef6f7b-0780-4b52-9695-f792cc75a490 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:12.562726 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-51ef6f7b-0780-4b52-9695-f792cc75a490 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:12.841755 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-93ba3e03-874c-41d8-93b5-3363a0f38a3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:12.884616 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-93ba3e03-874c-41d8-93b5-3363a0f38a3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:12.891074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-93ba3e03-874c-41d8-93b5-3363a0f38a3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:12.899910 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-93ba3e03-874c-41d8-93b5-3363a0f38a3f tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.990814 Jul 12 13:49:12.906750 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 473/941] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:11 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:13.032191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-51ef6f7b-0780-4b52-9695-f792cc75a490 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:13.046819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-51ef6f7b-0780-4b52-9695-f792cc75a490 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.519753 Jul 12 13:49:13.053342 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 469/942] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:12 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:13.641352 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-8dc25cd2-5bee-47e9-94b2-8f681eea1b80 req-42795222-d0f2-4795-a6c4-cf5a291600e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce9fd72-427a-46b2-99bf-4f5df789bbcc", "tag": "2f35e6cf-0b8f-40d3-bf22-0e4968c53e76"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:13.698442 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-8dc25cd2-5bee-47e9-94b2-8f681eea1b80 req-42795222-d0f2-4795-a6c4-cf5a291600e5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:13.700258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-8dc25cd2-5bee-47e9-94b2-8f681eea1b80 req-42795222-d0f2-4795-a6c4-cf5a291600e5 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:13.924142 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a2dca298-64c0-4900-a270-90739730ecba tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:13.925670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a2dca298-64c0-4900-a270-90739730ecba tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:13.936904 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a2dca298-64c0-4900-a270-90739730ecba tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:13.946883 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a2dca298-64c0-4900-a270-90739730ecba tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:13.948355 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a2dca298-64c0-4900-a270-90739730ecba tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:13.949141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a2dca298-64c0-4900-a270-90739730ecba tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:14.128776 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-8dc25cd2-5bee-47e9-94b2-8f681eea1b80 req-42795222-d0f2-4795-a6c4-cf5a291600e5 service nova] Creating event network-changed:2f35e6cf-0b8f-40d3-bf22-0e4968c53e76 for instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc on hv-cinder-79797 Jul 12 13:49:14.137739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-8dc25cd2-5bee-47e9-94b2-8f681eea1b80 req-42795222-d0f2-4795-a6c4-cf5a291600e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.501577 Jul 12 13:49:14.139183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 474/943] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:14.144654 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-b5c51b36-736a-4268-b6ad-43449e931456 req-c0edaf01-4cae-4217-9660-3f5c9e83da15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ae49d6-301e-4cf8-9037-3b59098c81c9", "name": "network-vif-plugged", "status": "completed", "tag": "f5b2cadb-da8b-47ae-8893-71246ab085ad"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:14.159108 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b5c51b36-736a-4268-b6ad-43449e931456 req-c0edaf01-4cae-4217-9660-3f5c9e83da15 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:14.159823 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b5c51b36-736a-4268-b6ad-43449e931456 req-c0edaf01-4cae-4217-9660-3f5c9e83da15 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:14.238858 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-b5c51b36-736a-4268-b6ad-43449e931456 req-c0edaf01-4cae-4217-9660-3f5c9e83da15 service nova] Creating event network-vif-plugged:f5b2cadb-da8b-47ae-8893-71246ab085ad for instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 on hv-cinder-79797 Jul 12 13:49:14.265364 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-b5c51b36-736a-4268-b6ad-43449e931456 req-c0edaf01-4cae-4217-9660-3f5c9e83da15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124523 Jul 12 13:49:14.281504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 475/944] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:14.320518 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-de53ab36-d660-42c8-b355-de22cd5959de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:14.326333 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-de53ab36-d660-42c8-b355-de22cd5959de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:14.349734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de53ab36-d660-42c8-b355-de22cd5959de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:14.364040 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de53ab36-d660-42c8-b355-de22cd5959de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:14.366586 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de53ab36-d660-42c8-b355-de22cd5959de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:14.374082 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de53ab36-d660-42c8-b355-de22cd5959de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:14.542758 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a2dca298-64c0-4900-a270-90739730ecba tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:14.571917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a2dca298-64c0-4900-a270-90739730ecba tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:14.580064 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a2dca298-64c0-4900-a270-90739730ecba tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:14.581318 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a2dca298-64c0-4900-a270-90739730ecba tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.661517 Jul 12 13:49:14.581905 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 470/945] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:13 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 13:49:15.247009 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-de53ab36-d660-42c8-b355-de22cd5959de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:15.261849 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-de53ab36-d660-42c8-b355-de22cd5959de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.974798 Jul 12 13:49:15.264849 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 476/946] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:14 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:15.599805 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-1fe3f59c-98d4-4eab-987e-15d2a12c3f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:15.600434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-1fe3f59c-98d4-4eab-987e-15d2a12c3f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:15.619200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1fe3f59c-98d4-4eab-987e-15d2a12c3f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:15.619648 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1fe3f59c-98d4-4eab-987e-15d2a12c3f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:15.631144 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1fe3f59c-98d4-4eab-987e-15d2a12c3f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:15.634194 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-1fe3f59c-98d4-4eab-987e-15d2a12c3f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:16.283558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6534bc6c-7026-485a-a3aa-b6ff70fa60d5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:16.284968 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6534bc6c-7026-485a-a3aa-b6ff70fa60d5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:16.287170 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:16.318139 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6534bc6c-7026-485a-a3aa-b6ff70fa60d5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:16.318622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6534bc6c-7026-485a-a3aa-b6ff70fa60d5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:16.323985 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6534bc6c-7026-485a-a3aa-b6ff70fa60d5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:16.325336 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6534bc6c-7026-485a-a3aa-b6ff70fa60d5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:16.506564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:16.560098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1fe3f59c-98d4-4eab-987e-15d2a12c3f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:16.569319 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1fe3f59c-98d4-4eab-987e-15d2a12c3f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:16.579629 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-1fe3f59c-98d4-4eab-987e-15d2a12c3f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:16.597204 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-1fe3f59c-98d4-4eab-987e-15d2a12c3f98 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.999579 Jul 12 13:49:16.609439 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 471/947] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:15 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:17.122549 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6534bc6c-7026-485a-a3aa-b6ff70fa60d5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:17.135238 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6534bc6c-7026-485a-a3aa-b6ff70fa60d5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.854400 Jul 12 13:49:17.139254 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 477/948] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:16 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:17.616285 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ac6b0476-fa2a-49e9-8f1a-ecf0aea44066 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:17.617044 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ac6b0476-fa2a-49e9-8f1a-ecf0aea44066 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:17.637075 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ac6b0476-fa2a-49e9-8f1a-ecf0aea44066 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:17.643724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ac6b0476-fa2a-49e9-8f1a-ecf0aea44066 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:17.645953 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ac6b0476-fa2a-49e9-8f1a-ecf0aea44066 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:17.646917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ac6b0476-fa2a-49e9-8f1a-ecf0aea44066 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:18.005258 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ac6b0476-fa2a-49e9-8f1a-ecf0aea44066 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:18.021540 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ac6b0476-fa2a-49e9-8f1a-ecf0aea44066 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:18.023761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ac6b0476-fa2a-49e9-8f1a-ecf0aea44066 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:18.036781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ac6b0476-fa2a-49e9-8f1a-ecf0aea44066 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.420213 Jul 12 13:49:18.038199 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 472/949] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:17 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:18.153468 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d0d6d835-a531-48b7-90c7-4b36fd91c09e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:18.154151 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d0d6d835-a531-48b7-90c7-4b36fd91c09e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:18.171960 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d0d6d835-a531-48b7-90c7-4b36fd91c09e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:18.172439 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d0d6d835-a531-48b7-90c7-4b36fd91c09e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:18.175760 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d0d6d835-a531-48b7-90c7-4b36fd91c09e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:18.176223 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d0d6d835-a531-48b7-90c7-4b36fd91c09e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:18.632812 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d0d6d835-a531-48b7-90c7-4b36fd91c09e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:18.666391 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d0d6d835-a531-48b7-90c7-4b36fd91c09e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.517761 Jul 12 13:49:18.668189 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 478/950] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:18 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:19.065329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0e629495-dfc5-4cc6-89f4-bef86c0e2c52 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:19.065928 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0e629495-dfc5-4cc6-89f4-bef86c0e2c52 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:19.075349 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0e629495-dfc5-4cc6-89f4-bef86c0e2c52 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:19.075801 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0e629495-dfc5-4cc6-89f4-bef86c0e2c52 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:19.083471 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0e629495-dfc5-4cc6-89f4-bef86c0e2c52 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:19.085049 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0e629495-dfc5-4cc6-89f4-bef86c0e2c52 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:19.412752 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0e629495-dfc5-4cc6-89f4-bef86c0e2c52 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:19.425659 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0e629495-dfc5-4cc6-89f4-bef86c0e2c52 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:19.427213 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0e629495-dfc5-4cc6-89f4-bef86c0e2c52 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:19.435604 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0e629495-dfc5-4cc6-89f4-bef86c0e2c52 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1728 microversion: 2.20 time: 0.374785 Jul 12 13:49:19.443504 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 473/951] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:19 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1728 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:19.684642 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2b49fa2b-8a1c-4e65-99f9-b31957d6fc38 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:19.685303 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2b49fa2b-8a1c-4e65-99f9-b31957d6fc38 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:19.699321 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b49fa2b-8a1c-4e65-99f9-b31957d6fc38 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:19.700066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b49fa2b-8a1c-4e65-99f9-b31957d6fc38 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:19.702321 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b49fa2b-8a1c-4e65-99f9-b31957d6fc38 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:19.702783 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2b49fa2b-8a1c-4e65-99f9-b31957d6fc38 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:20.026355 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2b49fa2b-8a1c-4e65-99f9-b31957d6fc38 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:20.040535 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2b49fa2b-8a1c-4e65-99f9-b31957d6fc38 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.358546 Jul 12 13:49:20.042679 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 479/952] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:19 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:20.467451 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a347f8d5-d14a-4a0a-9807-ead69cc67e9e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:20.470100 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a347f8d5-d14a-4a0a-9807-ead69cc67e9e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:20.479764 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a347f8d5-d14a-4a0a-9807-ead69cc67e9e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:20.489900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a347f8d5-d14a-4a0a-9807-ead69cc67e9e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:20.492665 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a347f8d5-d14a-4a0a-9807-ead69cc67e9e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:20.496004 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a347f8d5-d14a-4a0a-9807-ead69cc67e9e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:20.746035 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a347f8d5-d14a-4a0a-9807-ead69cc67e9e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:20.758006 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a347f8d5-d14a-4a0a-9807-ead69cc67e9e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:20.761452 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a347f8d5-d14a-4a0a-9807-ead69cc67e9e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:20.762851 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a347f8d5-d14a-4a0a-9807-ead69cc67e9e tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1715 microversion: 2.20 time: 0.304159 Jul 12 13:49:20.763939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 474/953] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:49:20 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1715 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:49:21.063211 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-5ec7d1e6-a25f-4000-b9f4-8560f7c4a77d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:21.064427 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-5ec7d1e6-a25f-4000-b9f4-8560f7c4a77d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:21.079749 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5ec7d1e6-a25f-4000-b9f4-8560f7c4a77d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:21.081127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5ec7d1e6-a25f-4000-b9f4-8560f7c4a77d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:21.082897 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5ec7d1e6-a25f-4000-b9f4-8560f7c4a77d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:21.083893 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-5ec7d1e6-a25f-4000-b9f4-8560f7c4a77d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:21.092809 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3127e7fc-5d68-48ab-9eaf-1649159cbbcc tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Action: 'create', calling method: .version_select at 0x7f3a1648c790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-685996063", "metadata": {"Type": "work"}}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3127e7fc-5d68-48ab-9eaf-1649159cbbcc tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Request method failure captured: Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 121 Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXvgY_rpq9SzWYvIiEdQ4jt9JW1e6UsCk2Kg16Aie7HUjo154NxMU3iRcokYtmTK5kIsGXJVK9geHArj_lXyk0jdGCgxPSZzfMG8AGLSL3iVjMkLPu8_407yiKOat0wwQDJDFzftd5s0gzY8Q_vdSAXtm_IzfAEf_RpPb8dSy7rcGPw Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:21.124370 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9efa77222b784537858b15903d9d3b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9efa77222b784537858b15903d9d3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: f822616b61634cec89bd87a9b06165cf Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-685996063", "metadata": {"Type": "work"}}} Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: Jul 12 13:49:21.126815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-685996063', 'metadata': {'Type': 'work'}}}} Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise error Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:21.128149 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 13:49:21.129937 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 13:49:21.131569 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 13:49:21.131569 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.131569 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3127e7fc-5d68-48ab-9eaf-1649159cbbcc tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:21.131569 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3127e7fc-5d68-48ab-9eaf-1649159cbbcc tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.294079 Jul 12 13:49:21.132068 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 480/954] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jul 12 13:49:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 301 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 13:49:21.147145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2a542946-a58b-433c-a608-c0dab76c776b tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Action: 'create', calling method: .version_select at 0x7f3a1649f0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1668139211", "metadata": {"Type": "work"}}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2a542946-a58b-433c-a608-c0dab76c776b tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Request method failure captured: Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 120 Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXvgY_rpq9SzWYvIiEdQ4jt9JW1e6UsCk2Kg16Aie7HUjo154NxMU3iRcokYtmTK5kIsGXJVK9geHArj_lXyk0jdGCgxPSZzfMG8AGLSL3iVjMkLPu8_407yiKOat0wwQDJDFzftd5s0gzY8Q_vdSAXtm_IzfAEf_RpPb8dSy7rcGPw Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:21.154902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9efa77222b784537858b15903d9d3b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9efa77222b784537858b15903d9d3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: f822616b61634cec89bd87a9b06165cf Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1668139211", "metadata": {"Type": "work"}}} Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: Jul 12 13:49:21.156297 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1668139211', 'metadata': {'Type': 'work'}}}} Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise error Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi '0' Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:21.157107 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 13:49:21.158583 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 13:49:21.160999 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 13:49:21.160999 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.163527 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2a542946-a58b-433c-a608-c0dab76c776b tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:21.166447 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2a542946-a58b-433c-a608-c0dab76c776b tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025897 Jul 12 13:49:21.167450 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 481/955] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jul 12 13:49:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 13:49:21.186091 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-35419835-1726-4618-9c59-2ac0e5ed172b tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Action: 'create', calling method: .version_select at 0x7f3a1648c280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1000524229", "metadata": {"Type": "work"}}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-35419835-1726-4618-9c59-2ac0e5ed172b tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Request method failure captured: Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 119 Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXvgY_rpq9SzWYvIiEdQ4jt9JW1e6UsCk2Kg16Aie7HUjo154NxMU3iRcokYtmTK5kIsGXJVK9geHArj_lXyk0jdGCgxPSZzfMG8AGLSL3iVjMkLPu8_407yiKOat0wwQDJDFzftd5s0gzY8Q_vdSAXtm_IzfAEf_RpPb8dSy7rcGPw Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:21.189345 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9efa77222b784537858b15903d9d3b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9efa77222b784537858b15903d9d3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: f822616b61634cec89bd87a9b06165cf Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1000524229", "metadata": {"Type": "work"}}} Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: Jul 12 13:49:21.191376 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1000524229', 'metadata': {'Type': 'work'}}}} Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise error Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi '' Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:21.192284 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 13:49:21.195585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 13:49:21.199709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 13:49:21.199709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.199709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-35419835-1726-4618-9c59-2ac0e5ed172b tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:21.199709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-35419835-1726-4618-9c59-2ac0e5ed172b tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012117 Jul 12 13:49:21.199709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 482/956] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Jul 12 13:49:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:49:21.202916 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ad5e0709-1c73-4c73-a62a-133f54055f42 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Calling method '.version_select at 0x7f3a1a53fca0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:21.283179 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-ad5e0709-1c73-4c73-a62a-133f54055f42 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] HTTP exception thrown: Volume tempest-invalid-1797492118 could not be found. Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ad5e0709-1c73-4c73-a62a-133f54055f42 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Request method failure captured: Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1797492118 HTTP/1.1 Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXvgY_rpq9SzWYvIiEdQ4jt9JW1e6UsCk2Kg16Aie7HUjo154NxMU3iRcokYtmTK5kIsGXJVK9geHArj_lXyk0jdGCgxPSZzfMG8AGLSL3iVjMkLPu8_407yiKOat0wwQDJDFzftd5s0gzY8Q_vdSAXtm_IzfAEf_RpPb8dSy7rcGPw Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:21.306955 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9efa77222b784537858b15903d9d3b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9efa77222b784537858b15903d9d3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: f822616b61634cec89bd87a9b06165cf Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Volume tempest-invalid-1797492118 could not be found. Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'tempest-invalid-1797492118'} Jul 12 13:49:21.308660 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1797492118 could not be found. (HTTP 404) (Request-ID: req-dda8b7ac-e2c9-4963-a7f4-ae451f563e73) Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.309789 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:49:21.311443 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1797492118 could not be found. Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:21.318289 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1797492118 could not be found. Jul 12 13:49:21.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:21.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:21.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1797492118 could not be found. Jul 12 13:49:21.320116 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.327312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ad5e0709-1c73-4c73-a62a-133f54055f42 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Returning 404 to user: Volume tempest-invalid-1797492118 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:21.332211 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ad5e0709-1c73-4c73-a62a-133f54055f42 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1797492118" status: 404 len: 99 microversion: 2.1 time: 0.132841 Jul 12 13:49:21.342564 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 483/957] 10.222.0.52 () {58 vars in 1217 bytes} [Tue Jul 12 13:49:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1797492118 => generated 99 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 13:49:21.362446 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-dbb1c5af-31d3-44f2-b547-bb4ec5a78961 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006502 Jul 12 13:49:21.369658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 484/958] 10.222.0.52 () {58 vars in 1139 bytes} [Tue Jul 12 13:49:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 13:49:21.375543 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-bb4137b9-47aa-4d7f-9250-faf624bff53e tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004595 Jul 12 13:49:21.376098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 485/959] 10.222.0.52 () {58 vars in 1136 bytes} [Tue Jul 12 13:49:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 13:49:21.387221 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-28f18034-d9d1-427a-98a9-b4d0542d0f0d tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Calling method '.version_select at 0x7f3a16483b80>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:21.411632 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-5ec7d1e6-a25f-4000-b9f4-8560f7c4a77d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:21.422727 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-5ec7d1e6-a25f-4000-b9f4-8560f7c4a77d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.366736 Jul 12 13:49:21.423948 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 475/960] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:21 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:21.436187 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-28f18034-d9d1-427a-98a9-b4d0542d0f0d tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] HTTP exception thrown: Volume cf191b5b-ee95-4969-817e-1ea2dcc5d421 could not be found. Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-28f18034-d9d1-427a-98a9-b4d0542d0f0d tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Request method failure captured: Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/os-volumes/cf191b5b-ee95-4969-817e-1ea2dcc5d421 HTTP/1.1 Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXvgY_rpq9SzWYvIiEdQ4jt9JW1e6UsCk2Kg16Aie7HUjo154NxMU3iRcokYtmTK5kIsGXJVK9geHArj_lXyk0jdGCgxPSZzfMG8AGLSL3iVjMkLPu8_407yiKOat0wwQDJDFzftd5s0gzY8Q_vdSAXtm_IzfAEf_RpPb8dSy7rcGPw Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:49:21.438593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9efa77222b784537858b15903d9d3b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9efa77222b784537858b15903d9d3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: f822616b61634cec89bd87a9b06165cf Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Volume cf191b5b-ee95-4969-817e-1ea2dcc5d421 could not be found. Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'cf191b5b-ee95-4969-817e-1ea2dcc5d421'} Jul 12 13:49:21.440444 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cf191b5b-ee95-4969-817e-1ea2dcc5d421 could not be found. (HTTP 404) (Request-ID: req-fc938b5c-0de0-4957-aa3e-2b6e81b21641) Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.441727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:49:21.443157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cf191b5b-ee95-4969-817e-1ea2dcc5d421 could not be found. Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 13:49:21.444769 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cf191b5b-ee95-4969-817e-1ea2dcc5d421 could not be found. Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cf191b5b-ee95-4969-817e-1ea2dcc5d421 could not be found. Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-28f18034-d9d1-427a-98a9-b4d0542d0f0d tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Returning 404 to user: Volume cf191b5b-ee95-4969-817e-1ea2dcc5d421 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:21.447948 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-28f18034-d9d1-427a-98a9-b4d0542d0f0d tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/cf191b5b-ee95-4969-817e-1ea2dcc5d421" status: 404 len: 109 microversion: 2.1 time: 0.064555 Jul 12 13:49:21.450197 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 486/961] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jul 12 13:49:21 2022] DELETE /compute/v2.1/os-volumes/cf191b5b-ee95-4969-817e-1ea2dcc5d421 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:21.460085 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7fce60dd-c38d-46b2-b4bb-6209b11fbe80 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Calling method '.version_select at 0x7f3a15d6d550>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:21.508498 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-7fce60dd-c38d-46b2-b4bb-6209b11fbe80 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] HTTP exception thrown: Volume 3a282fa9-dfbc-4c46-9e6b-2af691dc413e could not be found. Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7fce60dd-c38d-46b2-b4bb-6209b11fbe80 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Request method failure captured: Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/os-volumes/3a282fa9-dfbc-4c46-9e6b-2af691dc413e HTTP/1.1 Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXvgY_rpq9SzWYvIiEdQ4jt9JW1e6UsCk2Kg16Aie7HUjo154NxMU3iRcokYtmTK5kIsGXJVK9geHArj_lXyk0jdGCgxPSZzfMG8AGLSL3iVjMkLPu8_407yiKOat0wwQDJDFzftd5s0gzY8Q_vdSAXtm_IzfAEf_RpPb8dSy7rcGPw Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:49:21.511762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9efa77222b784537858b15903d9d3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9efa77222b784537858b15903d9d3b18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9efa77222b784537858b15903d9d3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 9efa77222b784537858b15903d9d3b18 Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-VolumesNegativeTest-459019810 Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: f822616b61634cec89bd87a9b06165cf Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-VolumesNegativeTest-459019810-project Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Volume 3a282fa9-dfbc-4c46-9e6b-2af691dc413e could not be found. Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '3a282fa9-dfbc-4c46-9e6b-2af691dc413e'} Jul 12 13:49:21.513803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a282fa9-dfbc-4c46-9e6b-2af691dc413e could not be found. (HTTP 404) (Request-ID: req-8a35137b-8a10-485c-85b1-30308b64def9) Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.514877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:49:21.516569 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a282fa9-dfbc-4c46-9e6b-2af691dc413e could not be found. Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 13:49:21.519187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a282fa9-dfbc-4c46-9e6b-2af691dc413e could not be found. Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a282fa9-dfbc-4c46-9e6b-2af691dc413e could not be found. Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-7fce60dd-c38d-46b2-b4bb-6209b11fbe80 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] Returning 404 to user: Volume 3a282fa9-dfbc-4c46-9e6b-2af691dc413e could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-7fce60dd-c38d-46b2-b4bb-6209b11fbe80 tempest-VolumesNegativeTest-459019810 tempest-VolumesNegativeTest-459019810-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3a282fa9-dfbc-4c46-9e6b-2af691dc413e" status: 404 len: 109 microversion: 2.1 time: 0.061042 Jul 12 13:49:21.521253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 476/962] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:49:21 2022] GET /compute/v2.1/os-volumes/3a282fa9-dfbc-4c46-9e6b-2af691dc413e => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:49:22.444309 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7c5263e7-0020-4a79-b155-cdfe89a700f1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:22.444942 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7c5263e7-0020-4a79-b155-cdfe89a700f1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:22.451390 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c5263e7-0020-4a79-b155-cdfe89a700f1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:22.451846 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c5263e7-0020-4a79-b155-cdfe89a700f1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:22.452830 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c5263e7-0020-4a79-b155-cdfe89a700f1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:22.453435 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7c5263e7-0020-4a79-b155-cdfe89a700f1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:22.608075 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7c5263e7-0020-4a79-b155-cdfe89a700f1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:22.616240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7c5263e7-0020-4a79-b155-cdfe89a700f1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.179176 Jul 12 13:49:22.617008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 487/963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:22 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:23.630605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=16 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:23.640085 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-09a3f5d0-1933-4904-af75-e29bcd959a59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:23.640742 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-09a3f5d0-1933-4904-af75-e29bcd959a59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:23.647688 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09a3f5d0-1933-4904-af75-e29bcd959a59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:23.648155 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09a3f5d0-1933-4904-af75-e29bcd959a59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:23.650208 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09a3f5d0-1933-4904-af75-e29bcd959a59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:23.650570 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-09a3f5d0-1933-4904-af75-e29bcd959a59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:23.815809 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-09a3f5d0-1933-4904-af75-e29bcd959a59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:23.824999 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-09a3f5d0-1933-4904-af75-e29bcd959a59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.195048 Jul 12 13:49:23.826064 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 477/964] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:23 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:24.844855 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-34fa7432-7610-4f6b-9178-914552c0a8d0 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:24.845463 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-34fa7432-7610-4f6b-9178-914552c0a8d0 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:24.854765 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-34fa7432-7610-4f6b-9178-914552c0a8d0 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:24.855462 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-34fa7432-7610-4f6b-9178-914552c0a8d0 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:24.856579 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-34fa7432-7610-4f6b-9178-914552c0a8d0 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:24.857179 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-34fa7432-7610-4f6b-9178-914552c0a8d0 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:25.063580 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-34fa7432-7610-4f6b-9178-914552c0a8d0 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:25.074649 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-34fa7432-7610-4f6b-9178-914552c0a8d0 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.234988 Jul 12 13:49:25.075837 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 488/965] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:24 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:26.093403 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d1269b9a-f42c-401e-9bab-31362b970e6d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:26.094901 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d1269b9a-f42c-401e-9bab-31362b970e6d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:26.101153 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1269b9a-f42c-401e-9bab-31362b970e6d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:26.101915 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1269b9a-f42c-401e-9bab-31362b970e6d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:26.103018 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1269b9a-f42c-401e-9bab-31362b970e6d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:26.103627 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d1269b9a-f42c-401e-9bab-31362b970e6d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:26.255636 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d1269b9a-f42c-401e-9bab-31362b970e6d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:26.265387 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d1269b9a-f42c-401e-9bab-31362b970e6d tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.176445 Jul 12 13:49:26.265981 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 478/966] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:26 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:27.172229 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-8f624ae9-e82e-430a-9f6e-c2872e54adfa req-d00a39a1-804b-4276-99c9-5b704345ca4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce9fd72-427a-46b2-99bf-4f5df789bbcc", "name": "network-vif-plugged", "status": "completed", "tag": "2f35e6cf-0b8f-40d3-bf22-0e4968c53e76"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:27.184723 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-8f624ae9-e82e-430a-9f6e-c2872e54adfa req-d00a39a1-804b-4276-99c9-5b704345ca4b service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:27.185663 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-8f624ae9-e82e-430a-9f6e-c2872e54adfa req-d00a39a1-804b-4276-99c9-5b704345ca4b service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:27.200582 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-8f624ae9-e82e-430a-9f6e-c2872e54adfa req-d00a39a1-804b-4276-99c9-5b704345ca4b service nova] Creating event network-vif-plugged:2f35e6cf-0b8f-40d3-bf22-0e4968c53e76 for instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc on hv-cinder-79797 Jul 12 13:49:27.207206 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-8f624ae9-e82e-430a-9f6e-c2872e54adfa req-d00a39a1-804b-4276-99c9-5b704345ca4b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040653 Jul 12 13:49:27.207873 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 489/967] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:27.285602 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ed005c04-ec62-47eb-881b-ab6d06e851a7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:27.287788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ed005c04-ec62-47eb-881b-ab6d06e851a7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:27.310224 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ed005c04-ec62-47eb-881b-ab6d06e851a7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:27.315950 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ed005c04-ec62-47eb-881b-ab6d06e851a7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:27.319162 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ed005c04-ec62-47eb-881b-ab6d06e851a7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:27.319714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ed005c04-ec62-47eb-881b-ab6d06e851a7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:27.469810 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ed005c04-ec62-47eb-881b-ab6d06e851a7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:27.479342 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ed005c04-ec62-47eb-881b-ab6d06e851a7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.198984 Jul 12 13:49:27.479918 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 479/968] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:27 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:28.498125 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6b9a994b-2d29-4461-9550-dd596b375e59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:28.498820 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6b9a994b-2d29-4461-9550-dd596b375e59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:28.505160 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b9a994b-2d29-4461-9550-dd596b375e59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:28.505610 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b9a994b-2d29-4461-9550-dd596b375e59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:28.506399 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b9a994b-2d29-4461-9550-dd596b375e59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:28.506836 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6b9a994b-2d29-4461-9550-dd596b375e59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:28.647072 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6b9a994b-2d29-4461-9550-dd596b375e59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:28.654567 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6b9a994b-2d29-4461-9550-dd596b375e59 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1358 microversion: 2.1 time: 0.162149 Jul 12 13:49:28.655219 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 490/969] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:28 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:29.672764 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-80d22c13-6594-4a02-b788-ddcae815d4a2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:29.673379 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-80d22c13-6594-4a02-b788-ddcae815d4a2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:29.679843 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-80d22c13-6594-4a02-b788-ddcae815d4a2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:29.680293 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-80d22c13-6594-4a02-b788-ddcae815d4a2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:29.681047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-80d22c13-6594-4a02-b788-ddcae815d4a2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:29.681482 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-80d22c13-6594-4a02-b788-ddcae815d4a2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:29.816726 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-80d22c13-6594-4a02-b788-ddcae815d4a2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:29.824952 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-80d22c13-6594-4a02-b788-ddcae815d4a2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1548 microversion: 2.1 time: 0.156075 Jul 12 13:49:29.826141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 480/970] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:29 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:29.841857 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-07643dc1-e556-4611-9825-124b8cf554f2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:29.842488 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-07643dc1-e556-4611-9825-124b8cf554f2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:29.849008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07643dc1-e556-4611-9825-124b8cf554f2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:29.849456 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07643dc1-e556-4611-9825-124b8cf554f2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:29.850343 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07643dc1-e556-4611-9825-124b8cf554f2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:29.850729 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-07643dc1-e556-4611-9825-124b8cf554f2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:29.981285 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-07643dc1-e556-4611-9825-124b8cf554f2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:29.989570 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-07643dc1-e556-4611-9825-124b8cf554f2 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1548 microversion: 2.1 time: 0.151436 Jul 12 13:49:29.990175 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 491/971] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:29 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:30.005428 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-64e5fe21-fca5-49c7-97b6-c943d6b55229 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:30.008975 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-64e5fe21-fca5-49c7-97b6-c943d6b55229 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:30.009632 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-64e5fe21-fca5-49c7-97b6-c943d6b55229 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Searching by: {'deleted': False, 'project_id': '70562708174846e9bb7b1b128a629a98'} {{(pid=124465) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 13:49:30.016320 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-64e5fe21-fca5-49c7-97b6-c943d6b55229 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:30.016767 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-64e5fe21-fca5-49c7-97b6-c943d6b55229 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:30.017567 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-64e5fe21-fca5-49c7-97b6-c943d6b55229 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:30.018041 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-64e5fe21-fca5-49c7-97b6-c943d6b55229 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:30.107209 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.multi_cell_list [None req-64e5fe21-fca5-49c7-97b6-c943d6b55229 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124465) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 13:49:30.203254 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-64e5fe21-fca5-49c7-97b6-c943d6b55229 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201735 Jul 12 13:49:30.203833 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 481/972] 10.222.0.52 () {58 vars in 1124 bytes} [Tue Jul 12 13:49:30 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:30.214124 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f095de76-bbf9-48fb-adb0-8c134459ee21 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:30.214732 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f095de76-bbf9-48fb-adb0-8c134459ee21 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:30.220655 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f095de76-bbf9-48fb-adb0-8c134459ee21 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:30.221100 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f095de76-bbf9-48fb-adb0-8c134459ee21 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:30.221848 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f095de76-bbf9-48fb-adb0-8c134459ee21 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:30.222310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f095de76-bbf9-48fb-adb0-8c134459ee21 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:30.356163 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f095de76-bbf9-48fb-adb0-8c134459ee21 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:30.363672 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f095de76-bbf9-48fb-adb0-8c134459ee21 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1548 microversion: 2.1 time: 0.153497 Jul 12 13:49:30.364178 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 492/973] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:30 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:31.920938 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-433e67fa-a827-4fef-ab84-31f1275d7eae tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba997664-140c-4bea-a1eb-4ec6a4ef3325"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:31.922068 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-433e67fa-a827-4fef-ab84-31f1275d7eae tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:31.928528 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-433e67fa-a827-4fef-ab84-31f1275d7eae tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:31.928987 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-433e67fa-a827-4fef-ab84-31f1275d7eae tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:31.929756 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-433e67fa-a827-4fef-ab84-31f1275d7eae tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:31.930781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-433e67fa-a827-4fef-ab84-31f1275d7eae tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:32.182053 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-433e67fa-a827-4fef-ab84-31f1275d7eae tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "POST /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264922 Jul 12 13:49:32.182661 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 482/974] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Jul 12 13:49:31 2022] POST /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:39.302559 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-205557367", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2098390379", "security_groups": [{"name": "tempest-secgroup-smoke-1947365010"}], "networks": [{"uuid": "e9fd1337-7e22-4bb0-bc4e-c998afea205a"}], "block_device_mapping_v2": [{"uuid": "d25bdaac-d298-4967-9e5a-447ba27ddda2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:39.429782 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] validate_networks() for [('e9fd1337-7e22-4bb0-bc4e-c998afea205a', None, None, None, None, None)] {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:49:39.807198 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-478a1286-998d-4f59-a2d2-0a9a7791505e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:39.808464 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-478a1286-998d-4f59-a2d2-0a9a7791505e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:39.816579 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-478a1286-998d-4f59-a2d2-0a9a7791505e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:39.817034 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-478a1286-998d-4f59-a2d2-0a9a7791505e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:39.818478 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-478a1286-998d-4f59-a2d2-0a9a7791505e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:39.819203 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-478a1286-998d-4f59-a2d2-0a9a7791505e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:39.846557 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:39.970293 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-478a1286-998d-4f59-a2d2-0a9a7791505e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:39.979082 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-478a1286-998d-4f59-a2d2-0a9a7791505e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1594 microversion: 2.1 time: 0.178277 Jul 12 13:49:39.979646 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 483/975] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:39 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1594 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:49:40.024253 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:49:40.025092 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:49:40.025573 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:49:40.026003 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:49:40.026998 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:49:40.037682 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:40.038419 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:40.039310 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:40.040456 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:40.047607 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=77 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:40.059368 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Getting quotas for project dc981a893df54f079e63399ace23ef1c. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:49:40.063465 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Getting quotas for user 3dd90f756d724016b60c80e9c78cce41 and project dc981a893df54f079e63399ace23ef1c. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:49:40.134352 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:49:40.136558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d25bdaac-d298-4967-9e5a-447ba27ddda2',volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:49:40.284462 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7483c982-3894-4c97-ab8b-8d40d996e66c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.985768 Jul 12 13:49:40.290348 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 493/976] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:49:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:49:40.295369 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f05964be-5230-4374-bc54-38a3bf0a1ab8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:40.296126 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-f05964be-5230-4374-bc54-38a3bf0a1ab8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:40.303117 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:40.383771 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-f05964be-5230-4374-bc54-38a3bf0a1ab8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:40.392476 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f05964be-5230-4374-bc54-38a3bf0a1ab8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1088 microversion: 2.1 time: 0.101144 Jul 12 13:49:40.393230 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 484/977] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:40 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1088 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:41.410163 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-242878ab-62db-41b5-b121-162e3d32c66f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:41.410781 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-242878ab-62db-41b5-b121-162e3d32c66f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:41.417436 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-242878ab-62db-41b5-b121-162e3d32c66f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:41.417894 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-242878ab-62db-41b5-b121-162e3d32c66f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:41.418709 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-242878ab-62db-41b5-b121-162e3d32c66f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:41.419156 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-242878ab-62db-41b5-b121-162e3d32c66f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:41.483782 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-242878ab-62db-41b5-b121-162e3d32c66f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:41.491271 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-242878ab-62db-41b5-b121-162e3d32c66f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1138 microversion: 2.1 time: 0.085594 Jul 12 13:49:41.491836 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 494/978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:41 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:42.126742 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-6cd16576-e0a9-4d0e-8c9d-da0ef70f60e2 req-0d8e36e0-25d2-410c-8857-1afb7fc97d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce9fd72-427a-46b2-99bf-4f5df789bbcc", "tag": "2f35e6cf-0b8f-40d3-bf22-0e4968c53e76"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:42.135087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:42.138092 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-6cd16576-e0a9-4d0e-8c9d-da0ef70f60e2 req-0d8e36e0-25d2-410c-8857-1afb7fc97d6a service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:42.138647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-6cd16576-e0a9-4d0e-8c9d-da0ef70f60e2 req-0d8e36e0-25d2-410c-8857-1afb7fc97d6a service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:42.152517 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-6cd16576-e0a9-4d0e-8c9d-da0ef70f60e2 req-0d8e36e0-25d2-410c-8857-1afb7fc97d6a service nova] Creating event network-changed:2f35e6cf-0b8f-40d3-bf22-0e4968c53e76 for instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc on hv-cinder-79797 Jul 12 13:49:42.157856 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-6cd16576-e0a9-4d0e-8c9d-da0ef70f60e2 req-0d8e36e0-25d2-410c-8857-1afb7fc97d6a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034707 Jul 12 13:49:42.158686 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 485/979] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:42.509520 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a99cb1ea-c9b4-4585-93f1-446e3f49426c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:42.510273 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a99cb1ea-c9b4-4585-93f1-446e3f49426c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:42.517716 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a99cb1ea-c9b4-4585-93f1-446e3f49426c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:42.524504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a99cb1ea-c9b4-4585-93f1-446e3f49426c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:42.525368 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a99cb1ea-c9b4-4585-93f1-446e3f49426c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:42.526048 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a99cb1ea-c9b4-4585-93f1-446e3f49426c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:42.601012 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a99cb1ea-c9b4-4585-93f1-446e3f49426c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:42.610879 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a99cb1ea-c9b4-4585-93f1-446e3f49426c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1130 microversion: 2.1 time: 0.105838 Jul 12 13:49:42.611459 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 495/980] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:42 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1130 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:43.419162 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-66b6c9d6-714b-439e-80f8-3fe327bff397 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-688576434"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:43.419908 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-66b6c9d6-714b-439e-80f8-3fe327bff397 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:43.428793 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66b6c9d6-714b-439e-80f8-3fe327bff397 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:43.429407 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66b6c9d6-714b-439e-80f8-3fe327bff397 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:43.430913 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66b6c9d6-714b-439e-80f8-3fe327bff397 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:43.431452 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-66b6c9d6-714b-439e-80f8-3fe327bff397 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:43.562616 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.network.security_group_api [None req-66b6c9d6-714b-439e-80f8-3fe327bff397 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Adding security group 6d5d05b1-6e30-4bad-8320-c68932348971 to port 2f35e6cf-0b8f-40d3-bf22-0e4968c53e76 Jul 12 13:49:43.629094 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-81324792-c148-4d66-9ca4-38981393dd53 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:43.629907 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-81324792-c148-4d66-9ca4-38981393dd53 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:43.636676 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-81324792-c148-4d66-9ca4-38981393dd53 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:43.637279 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-81324792-c148-4d66-9ca4-38981393dd53 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:43.638219 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-81324792-c148-4d66-9ca4-38981393dd53 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:43.638891 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-81324792-c148-4d66-9ca4-38981393dd53 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:43.980920 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-81324792-c148-4d66-9ca4-38981393dd53 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:43.993388 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-81324792-c148-4d66-9ca4-38981393dd53 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1204 microversion: 2.1 time: 0.366835 Jul 12 13:49:44.008978 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 496/981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:43 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1204 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:44.162377 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-66b6c9d6-714b-439e-80f8-3fe327bff397 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "POST /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/action" status: 202 len: 0 microversion: 2.1 time: 0.747809 Jul 12 13:49:44.170149 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 486/982] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:49:43 2022] POST /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:49:44.173340 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7b254017-3293-4e7f-bc2a-f86c118ec240 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:44.175202 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7b254017-3293-4e7f-bc2a-f86c118ec240 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:44.177842 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-f34087b1-6d76-45f6-b5e0-7ad6ef7b1e26 req-5c7b3dc8-84c5-4607-93ed-b22f71ed2889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce9fd72-427a-46b2-99bf-4f5df789bbcc", "tag": "2f35e6cf-0b8f-40d3-bf22-0e4968c53e76"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:44.187882 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b254017-3293-4e7f-bc2a-f86c118ec240 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:44.188825 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b254017-3293-4e7f-bc2a-f86c118ec240 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:44.189882 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b254017-3293-4e7f-bc2a-f86c118ec240 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:44.190557 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7b254017-3293-4e7f-bc2a-f86c118ec240 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:44.190995 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-f34087b1-6d76-45f6-b5e0-7ad6ef7b1e26 req-5c7b3dc8-84c5-4607-93ed-b22f71ed2889 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:44.191519 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-f34087b1-6d76-45f6-b5e0-7ad6ef7b1e26 req-5c7b3dc8-84c5-4607-93ed-b22f71ed2889 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:44.206043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-f34087b1-6d76-45f6-b5e0-7ad6ef7b1e26 req-5c7b3dc8-84c5-4607-93ed-b22f71ed2889 service nova] Creating event network-changed:2f35e6cf-0b8f-40d3-bf22-0e4968c53e76 for instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc on hv-cinder-79797 Jul 12 13:49:44.214214 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-f34087b1-6d76-45f6-b5e0-7ad6ef7b1e26 req-5c7b3dc8-84c5-4607-93ed-b22f71ed2889 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042134 Jul 12 13:49:44.215398 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 487/983] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:44.562243 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7b254017-3293-4e7f-bc2a-f86c118ec240 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:44.572649 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7b254017-3293-4e7f-bc2a-f86c118ec240 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1640 microversion: 2.1 time: 0.403400 Jul 12 13:49:44.585141 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 497/984] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:44 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1640 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:45.017998 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-cd69c5c7-c048-4963-ab07-8bc6d8255e89 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:45.018770 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-cd69c5c7-c048-4963-ab07-8bc6d8255e89 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:45.027326 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd69c5c7-c048-4963-ab07-8bc6d8255e89 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:45.028010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd69c5c7-c048-4963-ab07-8bc6d8255e89 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:45.030752 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd69c5c7-c048-4963-ab07-8bc6d8255e89 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:45.031359 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-cd69c5c7-c048-4963-ab07-8bc6d8255e89 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:45.193135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-cd69c5c7-c048-4963-ab07-8bc6d8255e89 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:45.203172 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-cd69c5c7-c048-4963-ab07-8bc6d8255e89 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.190193 Jul 12 13:49:45.203761 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 488/985] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:45 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:45.828672 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-1eb7f7fb-cac5-475a-8738-285854c63276 req-f3ba6da2-0a94-409a-9f14-5b43a1c7e76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9ed0f9-c449-4b4a-8440-a199c233faee", "tag": "6cc8dd65-f30a-4319-b999-92912807ff2e"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:45.838206 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-1eb7f7fb-cac5-475a-8738-285854c63276 req-f3ba6da2-0a94-409a-9f14-5b43a1c7e76c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:45.838663 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-1eb7f7fb-cac5-475a-8738-285854c63276 req-f3ba6da2-0a94-409a-9f14-5b43a1c7e76c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:45.850692 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-1eb7f7fb-cac5-475a-8738-285854c63276 req-f3ba6da2-0a94-409a-9f14-5b43a1c7e76c service nova] Creating event network-changed:6cc8dd65-f30a-4319-b999-92912807ff2e for instance 5c9ed0f9-c449-4b4a-8440-a199c233faee on hv-cinder-79797 Jul 12 13:49:45.856965 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-1eb7f7fb-cac5-475a-8738-285854c63276 req-f3ba6da2-0a94-409a-9f14-5b43a1c7e76c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031999 Jul 12 13:49:45.859071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 498/986] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:46.220558 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-fa14f9ec-9cdb-472a-b1bc-e41dc088fb35 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:46.221149 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-fa14f9ec-9cdb-472a-b1bc-e41dc088fb35 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:46.228209 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fa14f9ec-9cdb-472a-b1bc-e41dc088fb35 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:46.228664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fa14f9ec-9cdb-472a-b1bc-e41dc088fb35 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:46.229436 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fa14f9ec-9cdb-472a-b1bc-e41dc088fb35 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:46.229877 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-fa14f9ec-9cdb-472a-b1bc-e41dc088fb35 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:46.361374 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-fa14f9ec-9cdb-472a-b1bc-e41dc088fb35 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:46.369559 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-fa14f9ec-9cdb-472a-b1bc-e41dc088fb35 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.152922 Jul 12 13:49:46.370249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 489/987] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:46 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:47.388398 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-46cc458c-3c7d-4d80-8715-a6568fd810a9 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:47.389082 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-46cc458c-3c7d-4d80-8715-a6568fd810a9 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:47.391013 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:47.396602 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46cc458c-3c7d-4d80-8715-a6568fd810a9 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:47.397081 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46cc458c-3c7d-4d80-8715-a6568fd810a9 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:47.397839 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46cc458c-3c7d-4d80-8715-a6568fd810a9 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:47.398298 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-46cc458c-3c7d-4d80-8715-a6568fd810a9 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:47.528917 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-46cc458c-3c7d-4d80-8715-a6568fd810a9 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:47.536358 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-46cc458c-3c7d-4d80-8715-a6568fd810a9 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.153241 Jul 12 13:49:47.536930 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 499/988] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:47 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:48.552589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e3d76da8-ae70-4e6b-a711-f7c814603f5f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:48.553195 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e3d76da8-ae70-4e6b-a711-f7c814603f5f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:48.560267 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e3d76da8-ae70-4e6b-a711-f7c814603f5f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:48.560710 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e3d76da8-ae70-4e6b-a711-f7c814603f5f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:48.561466 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e3d76da8-ae70-4e6b-a711-f7c814603f5f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:48.561897 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e3d76da8-ae70-4e6b-a711-f7c814603f5f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:48.719128 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e3d76da8-ae70-4e6b-a711-f7c814603f5f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:48.728043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e3d76da8-ae70-4e6b-a711-f7c814603f5f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.179228 Jul 12 13:49:48.728623 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 490/989] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:48 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:49.744826 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-130e4d4b-052e-491d-8e28-ff831889e12c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:49.745591 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-130e4d4b-052e-491d-8e28-ff831889e12c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:49.753111 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-130e4d4b-052e-491d-8e28-ff831889e12c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:49.753796 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-130e4d4b-052e-491d-8e28-ff831889e12c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:49.754907 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-130e4d4b-052e-491d-8e28-ff831889e12c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:49.755431 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-130e4d4b-052e-491d-8e28-ff831889e12c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:49.904645 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-130e4d4b-052e-491d-8e28-ff831889e12c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:49.912317 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-130e4d4b-052e-491d-8e28-ff831889e12c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.171713 Jul 12 13:49:49.912876 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 500/990] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:49 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:50.929304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-34f4a33b-8939-46c7-8717-09a7d7910747 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:50.929919 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-34f4a33b-8939-46c7-8717-09a7d7910747 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:50.932517 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:50.937788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-34f4a33b-8939-46c7-8717-09a7d7910747 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:50.938270 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-34f4a33b-8939-46c7-8717-09a7d7910747 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:50.939037 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-34f4a33b-8939-46c7-8717-09a7d7910747 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:50.939478 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-34f4a33b-8939-46c7-8717-09a7d7910747 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:51.086768 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-34f4a33b-8939-46c7-8717-09a7d7910747 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:51.094237 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-34f4a33b-8939-46c7-8717-09a7d7910747 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.168666 Jul 12 13:49:51.094819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 491/991] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:50 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:52.110839 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f8c4cd07-cf1a-4a7e-bcb3-0e1a54fa39c8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:52.111430 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f8c4cd07-cf1a-4a7e-bcb3-0e1a54fa39c8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:52.113248 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:52.114241 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:52.122276 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f8c4cd07-cf1a-4a7e-bcb3-0e1a54fa39c8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:52.122724 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f8c4cd07-cf1a-4a7e-bcb3-0e1a54fa39c8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:52.123504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f8c4cd07-cf1a-4a7e-bcb3-0e1a54fa39c8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:52.123930 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f8c4cd07-cf1a-4a7e-bcb3-0e1a54fa39c8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:52.317075 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f8c4cd07-cf1a-4a7e-bcb3-0e1a54fa39c8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:52.324720 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f8c4cd07-cf1a-4a7e-bcb3-0e1a54fa39c8 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.217737 Jul 12 13:49:52.325377 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 501/992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:52 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:53.341634 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8cdbc87a-1324-4565-8217-a995cfff0881 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:53.342305 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8cdbc87a-1324-4565-8217-a995cfff0881 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:53.349173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8cdbc87a-1324-4565-8217-a995cfff0881 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:53.349625 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8cdbc87a-1324-4565-8217-a995cfff0881 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:53.350432 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8cdbc87a-1324-4565-8217-a995cfff0881 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:53.350872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8cdbc87a-1324-4565-8217-a995cfff0881 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:53.486619 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8cdbc87a-1324-4565-8217-a995cfff0881 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:53.494012 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8cdbc87a-1324-4565-8217-a995cfff0881 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.156253 Jul 12 13:49:53.495069 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 492/993] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:53 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:54.512422 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e61cd443-4d75-4fda-8203-361b05d75a05 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:54.512963 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e61cd443-4d75-4fda-8203-361b05d75a05 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:54.519681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e61cd443-4d75-4fda-8203-361b05d75a05 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:54.520139 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e61cd443-4d75-4fda-8203-361b05d75a05 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:54.520925 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e61cd443-4d75-4fda-8203-361b05d75a05 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:54.521365 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e61cd443-4d75-4fda-8203-361b05d75a05 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:54.652704 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-e61cd443-4d75-4fda-8203-361b05d75a05 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:54.660079 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e61cd443-4d75-4fda-8203-361b05d75a05 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.152148 Jul 12 13:49:54.660634 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 502/994] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:54 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:55.676904 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b6d1eefb-87db-4716-ad67-4beff68afe31 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:55.677527 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-b6d1eefb-87db-4716-ad67-4beff68afe31 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:55.683917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6d1eefb-87db-4716-ad67-4beff68afe31 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:55.684368 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6d1eefb-87db-4716-ad67-4beff68afe31 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:55.685130 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6d1eefb-87db-4716-ad67-4beff68afe31 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:55.685574 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-b6d1eefb-87db-4716-ad67-4beff68afe31 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:55.814590 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-b6d1eefb-87db-4716-ad67-4beff68afe31 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:55.822167 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b6d1eefb-87db-4716-ad67-4beff68afe31 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.149189 Jul 12 13:49:55.823248 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 493/995] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:55 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:56.838999 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-381c895b-ea60-4cf6-8887-42c1e6898544 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:56.839533 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-381c895b-ea60-4cf6-8887-42c1e6898544 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:56.846039 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-381c895b-ea60-4cf6-8887-42c1e6898544 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:56.846490 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-381c895b-ea60-4cf6-8887-42c1e6898544 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:56.847257 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-381c895b-ea60-4cf6-8887-42c1e6898544 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:56.847695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-381c895b-ea60-4cf6-8887-42c1e6898544 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:56.979657 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-381c895b-ea60-4cf6-8887-42c1e6898544 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:56.987113 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-381c895b-ea60-4cf6-8887-42c1e6898544 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.152127 Jul 12 13:49:56.987678 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 503/996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:56 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:49:57.981015 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-f27fffcd-6f8b-4454-8d15-a86dc88fb207 req-258d1677-f195-43c6-ab1d-2a6627e6f197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9ed0f9-c449-4b4a-8440-a199c233faee", "name": "network-vif-plugged", "status": "completed", "tag": "6cc8dd65-f30a-4319-b999-92912807ff2e"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:49:57.990388 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-f27fffcd-6f8b-4454-8d15-a86dc88fb207 req-258d1677-f195-43c6-ab1d-2a6627e6f197 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:57.990822 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-f27fffcd-6f8b-4454-8d15-a86dc88fb207 req-258d1677-f195-43c6-ab1d-2a6627e6f197 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:58.002680 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-f27fffcd-6f8b-4454-8d15-a86dc88fb207 req-258d1677-f195-43c6-ab1d-2a6627e6f197 service nova] Creating event network-vif-plugged:6cc8dd65-f30a-4319-b999-92912807ff2e for instance 5c9ed0f9-c449-4b4a-8440-a199c233faee on hv-cinder-79797 Jul 12 13:49:58.004764 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-da02c027-b6e3-41e2-b9f4-ae10b346ac66 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:58.005574 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-da02c027-b6e3-41e2-b9f4-ae10b346ac66 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:58.007557 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-f27fffcd-6f8b-4454-8d15-a86dc88fb207 req-258d1677-f195-43c6-ab1d-2a6627e6f197 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030226 Jul 12 13:49:58.008318 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 494/997] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:49:58.014207 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-da02c027-b6e3-41e2-b9f4-ae10b346ac66 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:58.014701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-da02c027-b6e3-41e2-b9f4-ae10b346ac66 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:58.015511 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-da02c027-b6e3-41e2-b9f4-ae10b346ac66 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:58.015954 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-da02c027-b6e3-41e2-b9f4-ae10b346ac66 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:58.149130 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-da02c027-b6e3-41e2-b9f4-ae10b346ac66 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:58.156960 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-da02c027-b6e3-41e2-b9f4-ae10b346ac66 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.156671 Jul 12 13:49:58.157524 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 504/998] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:57 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:49:59.175123 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-2e0df805-f03a-464d-9dcf-52b73ad37a46 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:49:59.175811 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-2e0df805-f03a-464d-9dcf-52b73ad37a46 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:49:59.181916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2e0df805-f03a-464d-9dcf-52b73ad37a46 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:59.182387 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2e0df805-f03a-464d-9dcf-52b73ad37a46 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:59.183136 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2e0df805-f03a-464d-9dcf-52b73ad37a46 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:49:59.183564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-2e0df805-f03a-464d-9dcf-52b73ad37a46 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:49:59.310799 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-2e0df805-f03a-464d-9dcf-52b73ad37a46 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:49:59.318187 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-2e0df805-f03a-464d-9dcf-52b73ad37a46 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.147709 Jul 12 13:49:59.318793 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 495/999] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:49:59 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:00.334971 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ea739997-5b04-4d26-b082-38b3035b518d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:00.335589 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ea739997-5b04-4d26-b082-38b3035b518d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:00.342728 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ea739997-5b04-4d26-b082-38b3035b518d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:00.343189 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ea739997-5b04-4d26-b082-38b3035b518d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:00.343956 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ea739997-5b04-4d26-b082-38b3035b518d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:00.344400 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ea739997-5b04-4d26-b082-38b3035b518d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:00.475271 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ea739997-5b04-4d26-b082-38b3035b518d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:00.483106 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ea739997-5b04-4d26-b082-38b3035b518d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1260 microversion: 2.1 time: 0.151999 Jul 12 13:50:00.483688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 505/1000] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:00 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:01.499972 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4b3f1daf-48df-4dbe-8a51-df87fa86b888 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:01.500615 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4b3f1daf-48df-4dbe-8a51-df87fa86b888 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:01.507415 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b3f1daf-48df-4dbe-8a51-df87fa86b888 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:01.507846 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b3f1daf-48df-4dbe-8a51-df87fa86b888 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:01.508609 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b3f1daf-48df-4dbe-8a51-df87fa86b888 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:01.509047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b3f1daf-48df-4dbe-8a51-df87fa86b888 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:01.646861 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4b3f1daf-48df-4dbe-8a51-df87fa86b888 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:01.655338 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4b3f1daf-48df-4dbe-8a51-df87fa86b888 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1444 microversion: 2.1 time: 0.159245 Jul 12 13:50:01.655923 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 496/1001] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:01 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:01.673671 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-43a069c9-e44b-4ae3-bd0d-710f7df61364 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:01.674353 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-43a069c9-e44b-4ae3-bd0d-710f7df61364 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:01.680801 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-43a069c9-e44b-4ae3-bd0d-710f7df61364 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:01.681253 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-43a069c9-e44b-4ae3-bd0d-710f7df61364 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:01.682049 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-43a069c9-e44b-4ae3-bd0d-710f7df61364 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:01.682524 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-43a069c9-e44b-4ae3-bd0d-710f7df61364 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:01.906580 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-43a069c9-e44b-4ae3-bd0d-710f7df61364 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:01.914315 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-43a069c9-e44b-4ae3-bd0d-710f7df61364 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1444 microversion: 2.1 time: 0.245296 Jul 12 13:50:01.915404 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 506/1002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:01 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1444 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:02.796610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3d9b20ef-8824-4603-8959-efd5366d7ac1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:02.797539 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3d9b20ef-8824-4603-8959-efd5366d7ac1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:02.804054 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3d9b20ef-8824-4603-8959-efd5366d7ac1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:02.804511 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3d9b20ef-8824-4603-8959-efd5366d7ac1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:02.805292 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3d9b20ef-8824-4603-8959-efd5366d7ac1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:02.805735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3d9b20ef-8824-4603-8959-efd5366d7ac1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:02.834556 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3d9b20ef-8824-4603-8959-efd5366d7ac1 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042022 Jul 12 13:50:02.835122 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 497/1003] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Jul 12 13:50:02 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:02.894840 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6420d24c-daa4-46cd-a950-4e88060b5507 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:02.895332 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6420d24c-daa4-46cd-a950-4e88060b5507 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:02.902501 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6420d24c-daa4-46cd-a950-4e88060b5507 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:02.902958 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6420d24c-daa4-46cd-a950-4e88060b5507 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:02.903744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6420d24c-daa4-46cd-a950-4e88060b5507 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:02.904192 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6420d24c-daa4-46cd-a950-4e88060b5507 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:02.929738 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6420d24c-daa4-46cd-a950-4e88060b5507 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:50:03.007485 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6420d24c-daa4-46cd-a950-4e88060b5507 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 204 len: 0 microversion: 2.20 time: 0.116018 Jul 12 13:50:03.008556 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 507/1004] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Jul 12 13:50:02 2022] DELETE /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 13:50:03.016432 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-678b10bf-3e23-4385-a6b4-15cf5e5c4518 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:03.017405 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-678b10bf-3e23-4385-a6b4-15cf5e5c4518 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:03.023583 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-678b10bf-3e23-4385-a6b4-15cf5e5c4518 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:03.024029 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-678b10bf-3e23-4385-a6b4-15cf5e5c4518 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:03.024788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-678b10bf-3e23-4385-a6b4-15cf5e5c4518 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:03.025860 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-678b10bf-3e23-4385-a6b4-15cf5e5c4518 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:03.254737 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-678b10bf-3e23-4385-a6b4-15cf5e5c4518 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:03.263153 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-678b10bf-3e23-4385-a6b4-15cf5e5c4518 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:03.264823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-678b10bf-3e23-4385-a6b4-15cf5e5c4518 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:03.266120 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-678b10bf-3e23-4385-a6b4-15cf5e5c4518 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.253495 Jul 12 13:50:03.266678 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 498/1005] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:50:03 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:50:04.089400 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-4c396ace-97a3-4a41-b4b7-e650da4cc255 req-0904f079-bd9b-4f4f-8bf1-acafded538d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9ed0f9-c449-4b4a-8440-a199c233faee", "tag": "6cc8dd65-f30a-4319-b999-92912807ff2e"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:50:04.098035 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-4c396ace-97a3-4a41-b4b7-e650da4cc255 req-0904f079-bd9b-4f4f-8bf1-acafded538d1 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:04.098488 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-4c396ace-97a3-4a41-b4b7-e650da4cc255 req-0904f079-bd9b-4f4f-8bf1-acafded538d1 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:04.109992 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-4c396ace-97a3-4a41-b4b7-e650da4cc255 req-0904f079-bd9b-4f4f-8bf1-acafded538d1 service nova] Creating event network-changed:6cc8dd65-f30a-4319-b999-92912807ff2e for instance 5c9ed0f9-c449-4b4a-8440-a199c233faee on hv-cinder-79797 Jul 12 13:50:04.114815 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-4c396ace-97a3-4a41-b4b7-e650da4cc255 req-0904f079-bd9b-4f4f-8bf1-acafded538d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029582 Jul 12 13:50:04.115410 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 508/1006] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:50:04.284836 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-907c9087-cfc1-491f-9375-345b79f84338 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:04.285642 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-907c9087-cfc1-491f-9375-345b79f84338 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:04.294729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-907c9087-cfc1-491f-9375-345b79f84338 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:04.295185 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-907c9087-cfc1-491f-9375-345b79f84338 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:04.296253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-907c9087-cfc1-491f-9375-345b79f84338 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:04.296710 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-907c9087-cfc1-491f-9375-345b79f84338 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:04.445564 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-907c9087-cfc1-491f-9375-345b79f84338 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:04.454686 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-907c9087-cfc1-491f-9375-345b79f84338 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:04.456645 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-907c9087-cfc1-491f-9375-345b79f84338 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:04.457973 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-907c9087-cfc1-491f-9375-345b79f84338 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.177334 Jul 12 13:50:04.458647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 499/1007] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:50:04 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:50:05.477748 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f3bd342e-dbaf-48a6-b083-1e9be81f0127 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:05.479135 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f3bd342e-dbaf-48a6-b083-1e9be81f0127 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:05.485224 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3bd342e-dbaf-48a6-b083-1e9be81f0127 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:05.485675 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3bd342e-dbaf-48a6-b083-1e9be81f0127 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:05.486472 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3bd342e-dbaf-48a6-b083-1e9be81f0127 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:05.486915 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f3bd342e-dbaf-48a6-b083-1e9be81f0127 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:05.739866 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f3bd342e-dbaf-48a6-b083-1e9be81f0127 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:05.760131 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f3bd342e-dbaf-48a6-b083-1e9be81f0127 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:05.761801 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f3bd342e-dbaf-48a6-b083-1e9be81f0127 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9e5bc258de54fd6b3811401783a7408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54281ff11484f77b0d20fd039ef938e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:05.769007 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f3bd342e-dbaf-48a6-b083-1e9be81f0127 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 200 len: 1721 microversion: 2.20 time: 0.292244 Jul 12 13:50:05.771637 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 509/1008] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:50:05 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 13:50:06.209136 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-ad8c461b-bee5-4b85-974f-2ffa06550837 req-f983550f-5d54-4345-8839-e23313e838e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ae49d6-301e-4cf8-9037-3b59098c81c9", "name": "network-vif-deleted", "tag": "f5b2cadb-da8b-47ae-8893-71246ab085ad"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:50:06.228271 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-ad8c461b-bee5-4b85-974f-2ffa06550837 req-f983550f-5d54-4345-8839-e23313e838e8 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:06.229421 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-ad8c461b-bee5-4b85-974f-2ffa06550837 req-f983550f-5d54-4345-8839-e23313e838e8 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:06.244232 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-ad8c461b-bee5-4b85-974f-2ffa06550837 req-f983550f-5d54-4345-8839-e23313e838e8 service nova] Creating event network-vif-deleted:f5b2cadb-da8b-47ae-8893-71246ab085ad for instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 on hv-cinder-79797 Jul 12 13:50:06.266991 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-ad8c461b-bee5-4b85-974f-2ffa06550837 req-f983550f-5d54-4345-8839-e23313e838e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062443 Jul 12 13:50:06.268193 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 500/1009] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:50:06.788542 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ad656ac4-54bc-449a-9868-02229f06753d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:06.789146 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ad656ac4-54bc-449a-9868-02229f06753d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:06.796220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad656ac4-54bc-449a-9868-02229f06753d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:06.797015 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad656ac4-54bc-449a-9868-02229f06753d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:06.798422 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad656ac4-54bc-449a-9868-02229f06753d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:06.799240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ad656ac4-54bc-449a-9868-02229f06753d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:06.814911 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:06.816339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-ad656ac4-54bc-449a-9868-02229f06753d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] HTTP exception thrown: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ad656ac4-54bc-449a-9868-02229f06753d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Request method failure captured: Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 HTTP/1.1 Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo5YVbWKE0s-CXcm9k_7ZnOCz7_dPpZtaxsOXYXpNOMgGT1EIjLMzAANA4iu5se2nfAgfcPwwXX92xdY_VpfTApW7n3V6fTPMqcjtZwJqsbpVT_UW2iAUu5ku7wYeZzvJEDI7gNQaC8HarW3k4CNDl7i-M1KLCjJm3frCP-57ek1w4 Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:50:06.818263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: d9e5bc258de54fd6b3811401783a7408 Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:06.820066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'f1ae49d6-301e-4cf8-9037-3b59098c81c9'} Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:50:06.824970 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:06.826659 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:06.828122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ad656ac4-54bc-449a-9868-02229f06753d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Returning 404 to user: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:50:06.828122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ad656ac4-54bc-449a-9868-02229f06753d tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 404 len: 111 microversion: 2.20 time: 0.035198 Jul 12 13:50:06.828122 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 510/1010] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:50:06 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:50:06.830929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-48bec031-38d2-4167-affc-c51b5ae71887 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '.version_select at 0x7f3a15b9c670>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:06.853897 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-48bec031-38d2-4167-affc-c51b5ae71887 tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-447679651" status: 204 len: 0 microversion: 2.20 time: 0.028032 Jul 12 13:50:06.855109 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 501/1011] 10.222.0.52 () {60 vars in 1258 bytes} [Tue Jul 12 13:50:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-447679651 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 13:50:08.739165 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ee02225c-ed79-46b5-9cea-6b93ec6134dc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:08.739664 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ee02225c-ed79-46b5-9cea-6b93ec6134dc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:08.747986 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ee02225c-ed79-46b5-9cea-6b93ec6134dc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:08.748438 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ee02225c-ed79-46b5-9cea-6b93ec6134dc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:08.749207 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ee02225c-ed79-46b5-9cea-6b93ec6134dc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:08.749649 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ee02225c-ed79-46b5-9cea-6b93ec6134dc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:08.764143 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-ee02225c-ed79-46b5-9cea-6b93ec6134dc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] HTTP exception thrown: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ee02225c-ed79-46b5-9cea-6b93ec6134dc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Request method failure captured: Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 HTTP/1.1 Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo5YVbWKE0s-CXcm9k_7ZnOCz7_dPpZtaxsOXYXpNOMgGT1EIjLMzAANA4iu5se2nfAgfcPwwXX92xdY_VpfTApW7n3V6fTPMqcjtZwJqsbpVT_UW2iAUu5ku7wYeZzvJEDI7gNQaC8HarW3k4CNDl7i-M1KLCjJm3frCP-57ek1w4 Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:50:08.765684 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: d9e5bc258de54fd6b3811401783a7408 Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:08.767510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'f1ae49d6-301e-4cf8-9037-3b59098c81c9'} Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:50:08.768429 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:08.769951 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:08.771576 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ee02225c-ed79-46b5-9cea-6b93ec6134dc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Returning 404 to user: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:50:08.771576 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ee02225c-ed79-46b5-9cea-6b93ec6134dc tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 404 len: 111 microversion: 2.20 time: 0.032233 Jul 12 13:50:08.771576 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 511/1012] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Jul 12 13:50:08 2022] DELETE /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:50:08.776101 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8e9f23a9-c58c-4f6a-8ea2-9673153f459a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:08.776819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8e9f23a9-c58c-4f6a-8ea2-9673153f459a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: f1ae49d6-301e-4cf8-9037-3b59098c81c9] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:08.782997 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8e9f23a9-c58c-4f6a-8ea2-9673153f459a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:08.783438 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8e9f23a9-c58c-4f6a-8ea2-9673153f459a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:08.784182 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8e9f23a9-c58c-4f6a-8ea2-9673153f459a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:08.784612 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8e9f23a9-c58c-4f6a-8ea2-9673153f459a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:08.798023 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-8e9f23a9-c58c-4f6a-8ea2-9673153f459a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] HTTP exception thrown: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8e9f23a9-c58c-4f6a-8ea2-9673153f459a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Request method failure captured: Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 HTTP/1.1 Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXo5YVbWKE0s-CXcm9k_7ZnOCz7_dPpZtaxsOXYXpNOMgGT1EIjLMzAANA4iu5se2nfAgfcPwwXX92xdY_VpfTApW7n3V6fTPMqcjtZwJqsbpVT_UW2iAUu5ku7wYeZzvJEDI7gNQaC8HarW3k4CNDl7i-M1KLCjJm3frCP-57ek1w4 Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:50:08.799589 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: d9e5bc258de54fd6b3811401783a7408 Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:08.801409 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'f1ae49d6-301e-4cf8-9037-3b59098c81c9'} Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:50:08.805132 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. Jul 12 13:50:08.807253 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:08.809109 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8e9f23a9-c58c-4f6a-8ea2-9673153f459a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Returning 404 to user: Instance f1ae49d6-301e-4cf8-9037-3b59098c81c9 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:50:08.809109 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8e9f23a9-c58c-4f6a-8ea2-9673153f459a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9" status: 404 len: 111 microversion: 2.20 time: 0.029275 Jul 12 13:50:08.809109 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 502/1013] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:50:08 2022] GET /compute/v2.1/servers/f1ae49d6-301e-4cf8-9037-3b59098c81c9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:50:09.935203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8ed4f10d-5dc7-4cac-8103-71985ed4a2de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:09.935701 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-8ed4f10d-5dc7-4cac-8103-71985ed4a2de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:09.942203 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8ed4f10d-5dc7-4cac-8103-71985ed4a2de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:09.942655 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8ed4f10d-5dc7-4cac-8103-71985ed4a2de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:09.944064 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8ed4f10d-5dc7-4cac-8103-71985ed4a2de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:09.944512 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-8ed4f10d-5dc7-4cac-8103-71985ed4a2de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:09.960655 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-8ed4f10d-5dc7-4cac-8103-71985ed4a2de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] HTTP exception thrown: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8ed4f10d-5dc7-4cac-8103-71985ed4a2de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Request method failure captured: Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 HTTP/1.1 Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXo5YVbWKE0s-CXcm9k_7ZnOCz7_dPpZtaxsOXYXpNOMgGT1EIjLMzAANA4iu5se2nfAgfcPwwXX92xdY_VpfTApW7n3V6fTPMqcjtZwJqsbpVT_UW2iAUu5ku7wYeZzvJEDI7gNQaC8HarW3k4CNDl7i-M1KLCjJm3frCP-57ek1w4 Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:50:09.962632 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: d9e5bc258de54fd6b3811401783a7408 Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:50:09.964339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'e71d01af-d429-48d6-9f16-6255557bdb67'} Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:50:09.966734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:50:09.968240 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:09.969734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8ed4f10d-5dc7-4cac-8103-71985ed4a2de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Returning 404 to user: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:50:09.969734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8ed4f10d-5dc7-4cac-8103-71985ed4a2de tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 404 len: 111 microversion: 2.20 time: 0.033743 Jul 12 13:50:09.969734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 512/1014] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Jul 12 13:50:09 2022] DELETE /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:50:09.972826 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4b12d89b-a2c0-43c5-ade4-bbe0d78dff2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:09.973443 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4b12d89b-a2c0-43c5-ade4-bbe0d78dff2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] [instance: e71d01af-d429-48d6-9f16-6255557bdb67] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:09.979989 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b12d89b-a2c0-43c5-ade4-bbe0d78dff2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:09.980510 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b12d89b-a2c0-43c5-ade4-bbe0d78dff2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:09.981285 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b12d89b-a2c0-43c5-ade4-bbe0d78dff2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:09.981724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4b12d89b-a2c0-43c5-ade4-bbe0d78dff2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:09.984345 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=86 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:09.996058 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-4b12d89b-a2c0-43c5-ade4-bbe0d78dff2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] HTTP exception thrown: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4b12d89b-a2c0-43c5-ade4-bbe0d78dff2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Request method failure captured: Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 HTTP/1.1 Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXo5YVbWKE0s-CXcm9k_7ZnOCz7_dPpZtaxsOXYXpNOMgGT1EIjLMzAANA4iu5se2nfAgfcPwwXX92xdY_VpfTApW7n3V6fTPMqcjtZwJqsbpVT_UW2iAUu5ku7wYeZzvJEDI7gNQaC8HarW3k4CNDl7i-M1KLCjJm3frCP-57ek1w4 Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:50:09.997647 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e54281ff11484f77b0d20fd039ef938e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: e54281ff11484f77b0d20fd039ef938e Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1964330678 Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: d9e5bc258de54fd6b3811401783a7408 Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1964330678-project Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:50:09.999444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': 'e71d01af-d429-48d6-9f16-6255557bdb67'} Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:50:10.000434 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. Jul 12 13:50:10.001929 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:10.003568 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4b12d89b-a2c0-43c5-ade4-bbe0d78dff2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] Returning 404 to user: Instance e71d01af-d429-48d6-9f16-6255557bdb67 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:50:10.003568 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4b12d89b-a2c0-43c5-ade4-bbe0d78dff2a tempest-AttachVolumeShelveTestJSON-1964330678 tempest-AttachVolumeShelveTestJSON-1964330678-project] 10.222.0.52 "GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67" status: 404 len: 111 microversion: 2.20 time: 0.030014 Jul 12 13:50:10.003568 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 503/1015] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Jul 12 13:50:09 2022] GET /compute/v2.1/servers/e71d01af-d429-48d6-9f16-6255557bdb67 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 13:50:14.185589 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-8a086944-fd87-48bd-b79e-cea14d976209 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Action: 'create', calling method: .version_select at 0x7f3a164dc0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1737686239"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:50:14.489610 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-8a086944-fd87-48bd-b79e-cea14d976209 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.453462 Jul 12 13:50:14.490745 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 513/1016] 10.222.0.52 () {60 vars in 1154 bytes} [Tue Jul 12 13:50:14 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 456 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 13:50:14.501517 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-40bed5c6-ebde-43d3-82ba-ca832dcf5019 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a15b9c700>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:14.558047 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-40bed5c6-ebde-43d3-82ba-ca832dcf5019 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074" status: 200 len: 345 microversion: 2.1 time: 0.060200 Jul 12 13:50:14.558636 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 504/1017] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:50:14 2022] GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:50:15.570544 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-76d0b39f-4522-42e3-a466-a581ff0c7d6c tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a164dd820>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:15.620286 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-76d0b39f-4522-42e3-a466-a581ff0c7d6c tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074" status: 200 len: 346 microversion: 2.1 time: 0.054054 Jul 12 13:50:15.620848 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 514/1018] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:50:15 2022] GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:50:15.632465 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b61d56ac-33a3-4598-a21b-17409244e722 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Action: 'create', calling method: .version_select at 0x7f3a15ca7e50>, body: {"snapshot": {"volume_id": "8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-874155822"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:50:15.795861 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b61d56ac-33a3-4598-a21b-17409244e722 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.167573 Jul 12 13:50:15.801398 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 505/1019] 10.222.0.52 () {60 vars in 1161 bytes} [Tue Jul 12 13:50:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:50:15.808153 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-0aba8a07-e4b6-488c-a7c5-2c3db08c1fc1 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a164dc700>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:15.843417 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-0aba8a07-e4b6-488c-a7c5-2c3db08c1fc1 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270" status: 200 len: 286 microversion: 2.1 time: 0.040458 Jul 12 13:50:15.843980 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 515/1020] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jul 12 13:50:15 2022] GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:50:15.860330 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-00f7718a-3e9d-4509-98c1-23e2d0818c41 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a160be1f0>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:15.900713 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-00f7718a-3e9d-4509-98c1-23e2d0818c41 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.045577 Jul 12 13:50:15.901304 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 506/1021] 10.222.0.52 () {58 vars in 1139 bytes} [Tue Jul 12 13:50:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:50:15.913749 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-606a5433-eb4b-4d93-8f11-243a0abfb733 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a1a553820>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:15.964312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-606a5433-eb4b-4d93-8f11-243a0abfb733 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270" status: 200 len: 286 microversion: 2.1 time: 0.052475 Jul 12 13:50:15.964312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 516/1022] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jul 12 13:50:15 2022] GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:50:16.639277 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-73c930c0-4bf3-4c2d-87ec-6c5722d73200 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:50:16.640261 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-73c930c0-4bf3-4c2d-87ec-6c5722d73200 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:16.642150 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:16.648305 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-73c930c0-4bf3-4c2d-87ec-6c5722d73200 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:16.649009 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-73c930c0-4bf3-4c2d-87ec-6c5722d73200 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:16.649792 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-73c930c0-4bf3-4c2d-87ec-6c5722d73200 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:16.650270 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-73c930c0-4bf3-4c2d-87ec-6c5722d73200 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:16.726401 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-73c930c0-4bf3-4c2d-87ec-6c5722d73200 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "POST /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/action" status: 202 len: 0 microversion: 2.1 time: 0.091819 Jul 12 13:50:16.727201 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 507/1023] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:50:16 2022] POST /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:50:16.743181 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2df22c6e-cbb2-4a1f-a7b9-d66cee269596 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:16.744305 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2df22c6e-cbb2-4a1f-a7b9-d66cee269596 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:16.752658 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2df22c6e-cbb2-4a1f-a7b9-d66cee269596 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:16.753607 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2df22c6e-cbb2-4a1f-a7b9-d66cee269596 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:16.754725 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2df22c6e-cbb2-4a1f-a7b9-d66cee269596 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:16.755366 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2df22c6e-cbb2-4a1f-a7b9-d66cee269596 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:16.907654 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2df22c6e-cbb2-4a1f-a7b9-d66cee269596 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:16.916254 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2df22c6e-cbb2-4a1f-a7b9-d66cee269596 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1750 microversion: 2.1 time: 0.184370 Jul 12 13:50:16.916822 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 517/1024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:16 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:16.974467 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-99bf8dcc-407e-440c-b943-2429d4c19dbe tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a15eec700>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:17.006380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-99bf8dcc-407e-440c-b943-2429d4c19dbe tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270" status: 200 len: 286 microversion: 2.1 time: 0.035949 Jul 12 13:50:17.006959 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 508/1025] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jul 12 13:50:16 2022] GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:50:17.935914 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-390e3144-aaba-4978-a0d6-1ab26a578b30 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:17.936597 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-390e3144-aaba-4978-a0d6-1ab26a578b30 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:17.938901 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:17.944483 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-390e3144-aaba-4978-a0d6-1ab26a578b30 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:17.944929 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-390e3144-aaba-4978-a0d6-1ab26a578b30 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:17.945692 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-390e3144-aaba-4978-a0d6-1ab26a578b30 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:17.946166 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-390e3144-aaba-4978-a0d6-1ab26a578b30 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:18.017640 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-96dbb2d0-22ed-440f-b67c-874d20c17cac tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a15ca7820>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:18.047232 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-96dbb2d0-22ed-440f-b67c-874d20c17cac tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270" status: 200 len: 286 microversion: 2.1 time: 0.033783 Jul 12 13:50:18.048078 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 509/1026] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jul 12 13:50:18 2022] GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:50:18.089084 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-390e3144-aaba-4978-a0d6-1ab26a578b30 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:18.097090 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-390e3144-aaba-4978-a0d6-1ab26a578b30 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1750 microversion: 2.1 time: 0.165110 Jul 12 13:50:18.097698 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 518/1027] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:17 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:19.060193 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8c32f61e-f60f-44d1-9432-4cba334b4425 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a15dbbc10>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:19.091105 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8c32f61e-f60f-44d1-9432-4cba334b4425 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270" status: 200 len: 287 microversion: 2.1 time: 0.035983 Jul 12 13:50:19.091692 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 510/1028] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jul 12 13:50:19 2022] GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:50:19.101471 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b784a534-c271-42d6-9940-0ec89749e5b3 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a16483af0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:19.114397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4cc3c86a-4830-4b6a-a79a-0c006c92f8b1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:19.115403 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4cc3c86a-4830-4b6a-a79a-0c006c92f8b1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:19.122026 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4cc3c86a-4830-4b6a-a79a-0c006c92f8b1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:19.122595 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4cc3c86a-4830-4b6a-a79a-0c006c92f8b1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:19.123499 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4cc3c86a-4830-4b6a-a79a-0c006c92f8b1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:19.124164 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4cc3c86a-4830-4b6a-a79a-0c006c92f8b1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:19.175565 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b784a534-c271-42d6-9940-0ec89749e5b3 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270" status: 202 len: 0 microversion: 2.1 time: 0.077769 Jul 12 13:50:19.176423 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 519/1029] 10.222.0.52 () {58 vars in 1253 bytes} [Tue Jul 12 13:50:19 2022] DELETE /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:50:19.184442 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-58482c54-eeee-4522-afa6-dbe480d1cc3f tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a1a41f040>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:19.218222 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-58482c54-eeee-4522-afa6-dbe480d1cc3f tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270" status: 200 len: 286 microversion: 2.1 time: 0.037575 Jul 12 13:50:19.218943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 520/1030] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jul 12 13:50:19 2022] GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:50:19.279821 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-4cc3c86a-4830-4b6a-a79a-0c006c92f8b1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:19.288453 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4cc3c86a-4830-4b6a-a79a-0c006c92f8b1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1750 microversion: 2.1 time: 0.178503 Jul 12 13:50:19.289203 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 511/1031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:19 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:50:19.712461 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-417579544", "imageRef": "f0677827-d5ae-491d-ae2b-59f6fcc843b8", "flavorRef": "452"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:50:19.761618 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.network.neutron [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] validate_networks() for None {{(pid=124466) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 13:50:20.032123 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Flavor limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 13:50:20.032563 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Image limits 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 13:50:20.033046 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Flavor pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 13:50:20.033460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Image pref 0:0:0 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 13:50:20.033870 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.virt.hardware [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124466) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 13:50:20.043239 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:20.043692 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:20.044480 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:20.044918 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:20.062282 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Getting quotas for project 8156e0a1827642ef828e8b88343f088d. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 13:50:20.066217 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.quota [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Getting quotas for user 0c30e76da528404d964782e701cefce2 and project 8156e0a1827642ef828e8b88343f088d. Resources: {'cores', 'ram', 'instances'} {{(pid=124466) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 13:50:20.077137 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Going to run 1 instances... {{(pid=124466) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 13:50:20.079347 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0677827-d5ae-491d-ae2b-59f6fcc843b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124466) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 13:50:20.123355 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a9b4e964-be94-46ae-97c4-b87d56559942 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.414730 Jul 12 13:50:20.124328 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 521/1032] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Jul 12 13:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 13:50:20.134235 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-42f14ac3-4fe3-4648-aa52-57f66698968b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:20.134854 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-42f14ac3-4fe3-4648-aa52-57f66698968b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:20.186762 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-42f14ac3-4fe3-4648-aa52-57f66698968b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:20.193648 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-42f14ac3-4fe3-4648-aa52-57f66698968b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1214 microversion: 2.1 time: 0.063358 Jul 12 13:50:20.194247 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 512/1033] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:20 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:50:20.230328 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-de7a0dea-3cdf-45c6-bdaf-9f14ee5d8d6c tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a1a41f0d0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:20.255944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-de7a0dea-3cdf-45c6-bdaf-9f14ee5d8d6c tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] HTTP exception thrown: Snapshot cc277927-3ff5-43fb-ac44-d40df2ee9270 could not be found. Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-de7a0dea-3cdf-45c6-bdaf-9f14ee5d8d6c tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Request method failure captured: Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270 HTTP/1.1 Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXwVLKdrK4Xg_Oar0V91C1Xv0FwWyYfxaWFjp6wZmb0trRYf8NmouI_H9A-9WXSMW_MY9jXxfdFyNyFfsbfCUxzSIGywq8qq7uLpFZocuUjdcAiuYWhbEogS52BTlGU-Ix6YYKQ6eAGH6x3iayOe2s7iz9Ho6qhQL8pYJphB1Vvvh4g Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 6b42ffcbb47a464d8760cff525755b4e Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:50:20.268943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 6b42ffcbb47a464d8760cff525755b4e Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesSnapshotsTestJSON-95786756-project Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: 84c436bf88094a568a9a3e7ed761c4fa Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesSnapshotsTestJSON-95786756-project Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Snapshot cc277927-3ff5-43fb-ac44-d40df2ee9270 could not be found. Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': 'cc277927-3ff5-43fb-ac44-d40df2ee9270'} Jul 12 13:50:20.270733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cc277927-3ff5-43fb-ac44-d40df2ee9270 could not be found. (HTTP 404) (Request-ID: req-699a4ef4-7e7d-417a-994f-6261177bfd8a) Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:20.271865 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:50:20.273341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cc277927-3ff5-43fb-ac44-d40df2ee9270 could not be found. Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 13:50:20.275452 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cc277927-3ff5-43fb-ac44-d40df2ee9270 could not be found. Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cc277927-3ff5-43fb-ac44-d40df2ee9270 could not be found. Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-de7a0dea-3cdf-45c6-bdaf-9f14ee5d8d6c tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Returning 404 to user: Snapshot cc277927-3ff5-43fb-ac44-d40df2ee9270 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-de7a0dea-3cdf-45c6-bdaf-9f14ee5d8d6c tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270" status: 404 len: 111 microversion: 2.1 time: 0.044666 Jul 12 13:50:20.277008 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 522/1034] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Jul 12 13:50:20 2022] GET /compute/v2.1/os-snapshots/cc277927-3ff5-43fb-ac44-d40df2ee9270 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:50:20.279974 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4c18ed2e-8530-425a-9cd3-664706afb2f2 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a15ecbdc0>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:20.307881 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f91c06a9-bfe2-4a5c-aa98-206a67c273f4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:20.308545 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f91c06a9-bfe2-4a5c-aa98-206a67c273f4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:20.315167 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f91c06a9-bfe2-4a5c-aa98-206a67c273f4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:20.315625 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f91c06a9-bfe2-4a5c-aa98-206a67c273f4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:20.316408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f91c06a9-bfe2-4a5c-aa98-206a67c273f4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:20.316851 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f91c06a9-bfe2-4a5c-aa98-206a67c273f4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:20.348470 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4c18ed2e-8530-425a-9cd3-664706afb2f2 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074" status: 202 len: 0 microversion: 2.1 time: 0.072471 Jul 12 13:50:20.349044 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 513/1035] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jul 12 13:50:20 2022] DELETE /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:50:20.358494 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0e4e240e-736b-4c25-a88b-789609405fc4 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a15ca7430>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:20.418058 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0e4e240e-736b-4c25-a88b-789609405fc4 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074" status: 200 len: 345 microversion: 2.1 time: 0.063305 Jul 12 13:50:20.420639 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 514/1036] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:50:20 2022] GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:50:20.480228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f91c06a9-bfe2-4a5c-aa98-206a67c273f4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:20.489673 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f91c06a9-bfe2-4a5c-aa98-206a67c273f4 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1755 microversion: 2.1 time: 0.186337 Jul 12 13:50:20.490338 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 523/1037] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:20 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:50:21.211244 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c3e85e50-d200-4126-b968-bb5b06441e0b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:21.211872 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c3e85e50-d200-4126-b968-bb5b06441e0b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:21.217984 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c3e85e50-d200-4126-b968-bb5b06441e0b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:21.218466 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c3e85e50-d200-4126-b968-bb5b06441e0b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:21.219234 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c3e85e50-d200-4126-b968-bb5b06441e0b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:21.219670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c3e85e50-d200-4126-b968-bb5b06441e0b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:21.286610 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c3e85e50-d200-4126-b968-bb5b06441e0b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:21.294526 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c3e85e50-d200-4126-b968-bb5b06441e0b tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1272 microversion: 2.1 time: 0.087604 Jul 12 13:50:21.295086 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 515/1038] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:21 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:21.431553 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-64441c27-9742-460f-b51d-9bb7f8c9313f tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a164835e0>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:21.460868 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-64441c27-9742-460f-b51d-9bb7f8c9313f tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] HTTP exception thrown: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-64441c27-9742-460f-b51d-9bb7f8c9313f tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Request method failure captured: Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 HTTP/1.1 Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXwVLKdrK4Xg_Oar0V91C1Xv0FwWyYfxaWFjp6wZmb0trRYf8NmouI_H9A-9WXSMW_MY9jXxfdFyNyFfsbfCUxzSIGywq8qq7uLpFZocuUjdcAiuYWhbEogS52BTlGU-Ix6YYKQ6eAGH6x3iayOe2s7iz9Ho6qhQL8pYJphB1Vvvh4g Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 6b42ffcbb47a464d8760cff525755b4e Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:50:21.462856 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 6b42ffcbb47a464d8760cff525755b4e Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-VolumesSnapshotsTestJSON-95786756-project Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: 84c436bf88094a568a9a3e7ed761c4fa Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-VolumesSnapshotsTestJSON-95786756-project Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074'} Jul 12 13:50:21.464481 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. (HTTP 404) (Request-ID: req-8f707f7e-c673-4efe-99cd-3f84c52600cd) Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:21.465479 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:50:21.466924 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 13:50:21.468312 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.469700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.471210 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-64441c27-9742-460f-b51d-9bb7f8c9313f tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Returning 404 to user: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:50:21.472066 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-64441c27-9742-460f-b51d-9bb7f8c9313f tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074" status: 404 len: 109 microversion: 2.1 time: 0.045207 Jul 12 13:50:21.472623 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 524/1039] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:50:21 2022] GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:50:21.487292 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-81b2eb7a-e8fb-4d6d-82a1-dd1376e1aba7 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a15b9ce50>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:21.508356 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ef75a358-91ec-4900-8934-7e82c8d5ce8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:21.509043 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ef75a358-91ec-4900-8934-7e82c8d5ce8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:21.517598 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-81b2eb7a-e8fb-4d6d-82a1-dd1376e1aba7 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] HTTP exception thrown: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.519157 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ef75a358-91ec-4900-8934-7e82c8d5ce8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-81b2eb7a-e8fb-4d6d-82a1-dd1376e1aba7 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Request method failure captured: Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: DELETE /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 HTTP/1.1 Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXwVLKdrK4Xg_Oar0V91C1Xv0FwWyYfxaWFjp6wZmb0trRYf8NmouI_H9A-9WXSMW_MY9jXxfdFyNyFfsbfCUxzSIGywq8qq7uLpFZocuUjdcAiuYWhbEogS52BTlGU-Ix6YYKQ6eAGH6x3iayOe2s7iz9Ho6qhQL8pYJphB1Vvvh4g Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 6b42ffcbb47a464d8760cff525755b4e Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:50:21.519671 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 6b42ffcbb47a464d8760cff525755b4e Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-VolumesSnapshotsTestJSON-95786756-project Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 84c436bf88094a568a9a3e7ed761c4fa Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-VolumesSnapshotsTestJSON-95786756-project Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074'} Jul 12 13:50:21.521087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. (HTTP 404) (Request-ID: req-c415d907-2930-461a-9acb-a53707508f4d) Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:21.521922 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 13:50:21.523127 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 13:50:21.526900 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.529605 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.533439 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ef75a358-91ec-4900-8934-7e82c8d5ce8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:21.533642 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-81b2eb7a-e8fb-4d6d-82a1-dd1376e1aba7 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Returning 404 to user: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:50:21.533816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ef75a358-91ec-4900-8934-7e82c8d5ce8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:21.533816 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ef75a358-91ec-4900-8934-7e82c8d5ce8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:21.534177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-81b2eb7a-e8fb-4d6d-82a1-dd1376e1aba7 tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074" status: 404 len: 109 microversion: 2.1 time: 0.037729 Jul 12 13:50:21.534177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 516/1040] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Jul 12 13:50:21 2022] DELETE /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:50:21.534177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-79580d95-45da-443e-999b-049b626af37d tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Calling method '.version_select at 0x7f3a15f09af0>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:21.564978 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-79580d95-45da-443e-999b-049b626af37d tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] HTTP exception thrown: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-79580d95-45da-443e-999b-049b626af37d tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Request method failure captured: Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 HTTP/1.1 Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXwVLKdrK4Xg_Oar0V91C1Xv0FwWyYfxaWFjp6wZmb0trRYf8NmouI_H9A-9WXSMW_MY9jXxfdFyNyFfsbfCUxzSIGywq8qq7uLpFZocuUjdcAiuYWhbEogS52BTlGU-Ix6YYKQ6eAGH6x3iayOe2s7iz9Ho6qhQL8pYJphB1Vvvh4g Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 6b42ffcbb47a464d8760cff525755b4e Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:50:21.567010 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6b42ffcbb47a464d8760cff525755b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 6b42ffcbb47a464d8760cff525755b4e Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-95786756 Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-VolumesSnapshotsTestJSON-95786756-project Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 84c436bf88094a568a9a3e7ed761c4fa Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-VolumesSnapshotsTestJSON-95786756-project Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074'} Jul 12 13:50:21.568674 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. (HTTP 404) (Request-ID: req-5d2e4307-fdcd-4cf4-86a8-a3ecbb2ff7b1) Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:21.569669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 13:50:21.571133 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 13:50:21.572681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-79580d95-45da-443e-999b-049b626af37d tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] Returning 404 to user: Volume 8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-79580d95-45da-443e-999b-049b626af37d tempest-VolumesSnapshotsTestJSON-95786756 tempest-VolumesSnapshotsTestJSON-95786756-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074" status: 404 len: 109 microversion: 2.1 time: 0.043934 Jul 12 13:50:21.574173 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 517/1041] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Jul 12 13:50:21 2022] GET /compute/v2.1/os-volumes/8a9364f8-de1c-4a4a-9cf9-ad67f0e6e074 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 13:50:21.751258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ef75a358-91ec-4900-8934-7e82c8d5ce8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:21.760255 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ef75a358-91ec-4900-8934-7e82c8d5ce8b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1755 microversion: 2.1 time: 0.255844 Jul 12 13:50:21.760834 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 525/1042] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:21 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1755 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:50:22.312286 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c8f8ee37-76a0-4fee-884a-c695e61f20a7 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:22.312898 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c8f8ee37-76a0-4fee-884a-c695e61f20a7 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:22.319205 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c8f8ee37-76a0-4fee-884a-c695e61f20a7 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:22.319952 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c8f8ee37-76a0-4fee-884a-c695e61f20a7 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:22.320733 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c8f8ee37-76a0-4fee-884a-c695e61f20a7 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:22.321334 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c8f8ee37-76a0-4fee-884a-c695e61f20a7 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:22.491102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c8f8ee37-76a0-4fee-884a-c695e61f20a7 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:22.501250 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c8f8ee37-76a0-4fee-884a-c695e61f20a7 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1314 microversion: 2.1 time: 0.193367 Jul 12 13:50:22.502418 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 518/1043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:22 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:22.705732 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-f1f69c90-b7bb-4991-b595-86f51145e838 req-a78d23c6-bc32-4b84-adba-d1ea226ea0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b51f5b3-9795-4fb1-ab37-4b0e361dc063", "tag": "2806b93c-497d-4313-80c4-a9e4b974fc3d"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:50:22.739391 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-f1f69c90-b7bb-4991-b595-86f51145e838 req-a78d23c6-bc32-4b84-adba-d1ea226ea0e0 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:22.741624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-f1f69c90-b7bb-4991-b595-86f51145e838 req-a78d23c6-bc32-4b84-adba-d1ea226ea0e0 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:22.767898 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-f1f69c90-b7bb-4991-b595-86f51145e838 req-a78d23c6-bc32-4b84-adba-d1ea226ea0e0 service nova] Creating event network-changed:2806b93c-497d-4313-80c4-a9e4b974fc3d for instance 0b51f5b3-9795-4fb1-ab37-4b0e361dc063 on hv-cinder-79797 Jul 12 13:50:22.772932 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-f1f69c90-b7bb-4991-b595-86f51145e838 req-a78d23c6-bc32-4b84-adba-d1ea226ea0e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071089 Jul 12 13:50:22.774831 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 526/1044] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:50:22.776670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-ecb2892d-2e84-46b8-8203-312038f4e103 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:22.777281 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-ecb2892d-2e84-46b8-8203-312038f4e103 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:22.786023 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ecb2892d-2e84-46b8-8203-312038f4e103 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:22.786499 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ecb2892d-2e84-46b8-8203-312038f4e103 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:22.787280 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ecb2892d-2e84-46b8-8203-312038f4e103 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:22.787724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-ecb2892d-2e84-46b8-8203-312038f4e103 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:22.970448 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-ecb2892d-2e84-46b8-8203-312038f4e103 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:22.979147 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-ecb2892d-2e84-46b8-8203-312038f4e103 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1755 microversion: 2.1 time: 0.206278 Jul 12 13:50:22.981379 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 519/1045] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:22 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:23.519105 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b419ab5a-4fe0-4ab6-b813-e8e9749504ce tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:23.519794 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b419ab5a-4fe0-4ab6-b813-e8e9749504ce tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:23.526650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b419ab5a-4fe0-4ab6-b813-e8e9749504ce tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:23.527096 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b419ab5a-4fe0-4ab6-b813-e8e9749504ce tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:23.527853 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b419ab5a-4fe0-4ab6-b813-e8e9749504ce tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:23.528286 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b419ab5a-4fe0-4ab6-b813-e8e9749504ce tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:23.666613 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b419ab5a-4fe0-4ab6-b813-e8e9749504ce tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:23.674617 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b419ab5a-4fe0-4ab6-b813-e8e9749504ce tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1314 microversion: 2.1 time: 0.159627 Jul 12 13:50:23.675220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 527/1046] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:23 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:23.997268 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-96bad47c-ee05-48c2-9f75-85d1c9cab020 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:23.997838 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-96bad47c-ee05-48c2-9f75-85d1c9cab020 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:24.004231 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-96bad47c-ee05-48c2-9f75-85d1c9cab020 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:24.004679 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-96bad47c-ee05-48c2-9f75-85d1c9cab020 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:24.005432 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-96bad47c-ee05-48c2-9f75-85d1c9cab020 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:24.005861 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-96bad47c-ee05-48c2-9f75-85d1c9cab020 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:24.410988 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-96bad47c-ee05-48c2-9f75-85d1c9cab020 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:24.419783 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-96bad47c-ee05-48c2-9f75-85d1c9cab020 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1755 microversion: 2.1 time: 0.427115 Jul 12 13:50:24.420444 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 520/1047] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:23 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1755 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:24.691548 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-2214a5f2-c65c-408e-8327-2f02f3d18f76 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:24.692138 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-2214a5f2-c65c-408e-8327-2f02f3d18f76 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:24.699096 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2214a5f2-c65c-408e-8327-2f02f3d18f76 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:24.699096 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2214a5f2-c65c-408e-8327-2f02f3d18f76 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:24.699894 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2214a5f2-c65c-408e-8327-2f02f3d18f76 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:24.700515 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-2214a5f2-c65c-408e-8327-2f02f3d18f76 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:24.825983 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-2214a5f2-c65c-408e-8327-2f02f3d18f76 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:24.833439 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-2214a5f2-c65c-408e-8327-2f02f3d18f76 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1314 microversion: 2.1 time: 0.145851 Jul 12 13:50:24.834035 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 528/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:24 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:25.437565 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-91b9133b-4c4c-4cfe-9f4e-e2c0a31d3509 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:25.438261 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-91b9133b-4c4c-4cfe-9f4e-e2c0a31d3509 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:25.445079 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-91b9133b-4c4c-4cfe-9f4e-e2c0a31d3509 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:25.445533 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-91b9133b-4c4c-4cfe-9f4e-e2c0a31d3509 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:25.446333 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-91b9133b-4c4c-4cfe-9f4e-e2c0a31d3509 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:25.447341 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-91b9133b-4c4c-4cfe-9f4e-e2c0a31d3509 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:25.583631 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-91b9133b-4c4c-4cfe-9f4e-e2c0a31d3509 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:25.592532 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-91b9133b-4c4c-4cfe-9f4e-e2c0a31d3509 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1755 microversion: 2.1 time: 0.158923 Jul 12 13:50:25.593102 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 521/1049] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:25 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:25.850521 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-49758615-b77b-4c36-ad07-37f7cbb24f48 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:25.851140 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-49758615-b77b-4c36-ad07-37f7cbb24f48 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:25.860415 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49758615-b77b-4c36-ad07-37f7cbb24f48 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:25.860875 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49758615-b77b-4c36-ad07-37f7cbb24f48 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:25.861663 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49758615-b77b-4c36-ad07-37f7cbb24f48 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:25.862218 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-49758615-b77b-4c36-ad07-37f7cbb24f48 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:26.258404 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-49758615-b77b-4c36-ad07-37f7cbb24f48 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:26.266891 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-49758615-b77b-4c36-ad07-37f7cbb24f48 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1314 microversion: 2.1 time: 0.420581 Jul 12 13:50:26.267464 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 529/1050] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:25 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:26.610261 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3b2106fa-011a-4fba-b0a8-3877056df7cc tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:26.610868 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3b2106fa-011a-4fba-b0a8-3877056df7cc tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:26.617445 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3b2106fa-011a-4fba-b0a8-3877056df7cc tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:26.617895 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3b2106fa-011a-4fba-b0a8-3877056df7cc tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:26.619346 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3b2106fa-011a-4fba-b0a8-3877056df7cc tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:26.619784 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3b2106fa-011a-4fba-b0a8-3877056df7cc tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:26.763890 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3b2106fa-011a-4fba-b0a8-3877056df7cc tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:26.771914 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3b2106fa-011a-4fba-b0a8-3877056df7cc tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1755 microversion: 2.1 time: 0.165773 Jul 12 13:50:26.772484 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 522/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:26 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:27.284098 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f1eadf9d-9039-4a64-aee8-b83b298c8358 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:27.284707 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f1eadf9d-9039-4a64-aee8-b83b298c8358 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:27.291393 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1eadf9d-9039-4a64-aee8-b83b298c8358 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:27.291834 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1eadf9d-9039-4a64-aee8-b83b298c8358 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:27.292585 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1eadf9d-9039-4a64-aee8-b83b298c8358 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:27.293018 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f1eadf9d-9039-4a64-aee8-b83b298c8358 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:27.424269 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f1eadf9d-9039-4a64-aee8-b83b298c8358 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:27.431891 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f1eadf9d-9039-4a64-aee8-b83b298c8358 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1314 microversion: 2.1 time: 0.151557 Jul 12 13:50:27.432456 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 530/1052] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:27 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:27.788391 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-a72231a1-b9d2-4b14-961a-ae92ebfc64c8 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:27.789371 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-a72231a1-b9d2-4b14-961a-ae92ebfc64c8 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:27.796300 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a72231a1-b9d2-4b14-961a-ae92ebfc64c8 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:27.796863 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a72231a1-b9d2-4b14-961a-ae92ebfc64c8 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:27.797670 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a72231a1-b9d2-4b14-961a-ae92ebfc64c8 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:27.798203 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-a72231a1-b9d2-4b14-961a-ae92ebfc64c8 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:27.957310 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-a72231a1-b9d2-4b14-961a-ae92ebfc64c8 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:27.965565 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-a72231a1-b9d2-4b14-961a-ae92ebfc64c8 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1755 microversion: 2.1 time: 0.180888 Jul 12 13:50:27.966154 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 523/1053] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:27 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:28.449461 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-d972c3b9-1448-4a60-b482-3f5bfd0b0e4f tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:28.450706 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-d972c3b9-1448-4a60-b482-3f5bfd0b0e4f tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:28.457085 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d972c3b9-1448-4a60-b482-3f5bfd0b0e4f tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:28.457546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d972c3b9-1448-4a60-b482-3f5bfd0b0e4f tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:28.458346 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d972c3b9-1448-4a60-b482-3f5bfd0b0e4f tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:28.458788 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-d972c3b9-1448-4a60-b482-3f5bfd0b0e4f tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:28.590939 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-d972c3b9-1448-4a60-b482-3f5bfd0b0e4f tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:28.599227 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-d972c3b9-1448-4a60-b482-3f5bfd0b0e4f tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1314 microversion: 2.1 time: 0.154232 Jul 12 13:50:28.599797 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 531/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:28 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:28.982479 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c22bddf0-ee30-4292-94ea-640fb9850b5e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:28.983096 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c22bddf0-ee30-4292-94ea-640fb9850b5e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:28.989528 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c22bddf0-ee30-4292-94ea-640fb9850b5e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:28.990087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c22bddf0-ee30-4292-94ea-640fb9850b5e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:28.990778 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c22bddf0-ee30-4292-94ea-640fb9850b5e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:28.991408 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c22bddf0-ee30-4292-94ea-640fb9850b5e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:29.141074 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c22bddf0-ee30-4292-94ea-640fb9850b5e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:29.149015 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c22bddf0-ee30-4292-94ea-640fb9850b5e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1755 microversion: 2.1 time: 0.170310 Jul 12 13:50:29.150449 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 524/1055] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:28 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:29.619881 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-1329119a-53a5-4dd0-be56-a455ad1cb7bc tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:29.620510 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-1329119a-53a5-4dd0-be56-a455ad1cb7bc tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:29.626650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1329119a-53a5-4dd0-be56-a455ad1cb7bc tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:29.627364 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1329119a-53a5-4dd0-be56-a455ad1cb7bc tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:29.628142 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1329119a-53a5-4dd0-be56-a455ad1cb7bc tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:29.628578 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-1329119a-53a5-4dd0-be56-a455ad1cb7bc tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:29.772329 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-1329119a-53a5-4dd0-be56-a455ad1cb7bc tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:29.780539 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-1329119a-53a5-4dd0-be56-a455ad1cb7bc tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1314 microversion: 2.1 time: 0.166465 Jul 12 13:50:29.781323 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 532/1056] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:29 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:50:29.845345 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-70bfb256-c759-4729-a3d7-aceba09db776 req-ffaf2a64-0247-42b1-a44a-8d32c96b0d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b51f5b3-9795-4fb1-ab37-4b0e361dc063", "name": "network-vif-plugged", "status": "completed", "tag": "2806b93c-497d-4313-80c4-a9e4b974fc3d"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:50:29.856282 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-70bfb256-c759-4729-a3d7-aceba09db776 req-ffaf2a64-0247-42b1-a44a-8d32c96b0d3c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:29.856810 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-70bfb256-c759-4729-a3d7-aceba09db776 req-ffaf2a64-0247-42b1-a44a-8d32c96b0d3c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:29.871111 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-70bfb256-c759-4729-a3d7-aceba09db776 req-ffaf2a64-0247-42b1-a44a-8d32c96b0d3c service nova] Creating event network-vif-plugged:2806b93c-497d-4313-80c4-a9e4b974fc3d for instance 0b51f5b3-9795-4fb1-ab37-4b0e361dc063 on hv-cinder-79797 Jul 12 13:50:29.877381 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-70bfb256-c759-4729-a3d7-aceba09db776 req-ffaf2a64-0247-42b1-a44a-8d32c96b0d3c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035772 Jul 12 13:50:29.878387 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 525/1057] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:50:30.169381 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-02405668-ffb2-4fed-935c-5f71b597fb1b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:30.169527 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-02405668-ffb2-4fed-935c-5f71b597fb1b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:30.171663 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=2 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:30.172431 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell0:SELECT=6 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:30.178850 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02405668-ffb2-4fed-935c-5f71b597fb1b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:30.179300 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02405668-ffb2-4fed-935c-5f71b597fb1b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:30.180070 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02405668-ffb2-4fed-935c-5f71b597fb1b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:30.180513 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-02405668-ffb2-4fed-935c-5f71b597fb1b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:30.332228 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-02405668-ffb2-4fed-935c-5f71b597fb1b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:30.346015 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-02405668-ffb2-4fed-935c-5f71b597fb1b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1755 microversion: 2.1 time: 0.180821 Jul 12 13:50:30.356729 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 533/1058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:30 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:30.798081 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell0:SELECT=2 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:30.802303 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-6678414d-2a61-42b3-af13-3be9e7d3ea9c tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:30.803004 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-6678414d-2a61-42b3-af13-3be9e7d3ea9c tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:30.813354 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6678414d-2a61-42b3-af13-3be9e7d3ea9c tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:30.813879 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6678414d-2a61-42b3-af13-3be9e7d3ea9c tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:30.814930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6678414d-2a61-42b3-af13-3be9e7d3ea9c tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:30.815503 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-6678414d-2a61-42b3-af13-3be9e7d3ea9c tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:30.951443 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-6678414d-2a61-42b3-af13-3be9e7d3ea9c tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:30.959149 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-6678414d-2a61-42b3-af13-3be9e7d3ea9c tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1314 microversion: 2.1 time: 0.162557 Jul 12 13:50:30.959729 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 526/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:30 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:31.363902 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a61dab73-abe4-4ab4-9eeb-8fb833ed1bd3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:31.364637 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a61dab73-abe4-4ab4-9eeb-8fb833ed1bd3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:31.371380 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a61dab73-abe4-4ab4-9eeb-8fb833ed1bd3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:31.371907 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a61dab73-abe4-4ab4-9eeb-8fb833ed1bd3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:31.372682 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a61dab73-abe4-4ab4-9eeb-8fb833ed1bd3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:31.373123 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a61dab73-abe4-4ab4-9eeb-8fb833ed1bd3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:31.531490 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a61dab73-abe4-4ab4-9eeb-8fb833ed1bd3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:31.540492 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a61dab73-abe4-4ab4-9eeb-8fb833ed1bd3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1758 microversion: 2.1 time: 0.180486 Jul 12 13:50:31.541071 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 534/1060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:31 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:31.976380 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-661edcdf-37d7-469a-b970-6bc0e427ee69 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:31.977004 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-661edcdf-37d7-469a-b970-6bc0e427ee69 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:31.984059 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-661edcdf-37d7-469a-b970-6bc0e427ee69 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:31.984514 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-661edcdf-37d7-469a-b970-6bc0e427ee69 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:31.985281 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-661edcdf-37d7-469a-b970-6bc0e427ee69 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:31.985720 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-661edcdf-37d7-469a-b970-6bc0e427ee69 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:32.121506 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-661edcdf-37d7-469a-b970-6bc0e427ee69 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:32.129191 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-661edcdf-37d7-469a-b970-6bc0e427ee69 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1463 microversion: 2.1 time: 0.156721 Jul 12 13:50:32.129918 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 527/1061] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:31 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:32.169836 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-de067a09-9520-4b7e-9129-a01a3cebe334 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:32.170366 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-de067a09-9520-4b7e-9129-a01a3cebe334 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:32.176624 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de067a09-9520-4b7e-9129-a01a3cebe334 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:32.177077 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de067a09-9520-4b7e-9129-a01a3cebe334 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:32.177844 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de067a09-9520-4b7e-9129-a01a3cebe334 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:32.178318 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-de067a09-9520-4b7e-9129-a01a3cebe334 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:32.203775 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-de067a09-9520-4b7e-9129-a01a3cebe334 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Going to try to terminate instance {{(pid=124466) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:50:32.282561 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-de067a09-9520-4b7e-9129-a01a3cebe334 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 204 len: 0 microversion: 2.1 time: 0.116642 Jul 12 13:50:32.283403 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 535/1062] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:50:32 2022] DELETE /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:50:32.292074 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-14d966b9-9612-496d-a69f-741e65ceb643 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:32.292843 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-14d966b9-9612-496d-a69f-741e65ceb643 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:32.299206 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-14d966b9-9612-496d-a69f-741e65ceb643 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:32.299735 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-14d966b9-9612-496d-a69f-741e65ceb643 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:32.300580 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-14d966b9-9612-496d-a69f-741e65ceb643 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:32.301112 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-14d966b9-9612-496d-a69f-741e65ceb643 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:32.441995 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-14d966b9-9612-496d-a69f-741e65ceb643 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:32.450084 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-14d966b9-9612-496d-a69f-741e65ceb643 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1469 microversion: 2.1 time: 0.162440 Jul 12 13:50:32.450748 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 528/1063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:32 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:33.468287 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b3014436-5fd2-45b0-8bde-e0ab98bc78b1 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:33.468995 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b3014436-5fd2-45b0-8bde-e0ab98bc78b1 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:33.475504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3014436-5fd2-45b0-8bde-e0ab98bc78b1 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:33.475962 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3014436-5fd2-45b0-8bde-e0ab98bc78b1 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:33.476735 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3014436-5fd2-45b0-8bde-e0ab98bc78b1 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:33.477172 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b3014436-5fd2-45b0-8bde-e0ab98bc78b1 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:33.492811 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:33.615676 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b3014436-5fd2-45b0-8bde-e0ab98bc78b1 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:33.624062 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b3014436-5fd2-45b0-8bde-e0ab98bc78b1 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1469 microversion: 2.1 time: 0.159998 Jul 12 13:50:33.624633 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 536/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:33 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:50:34.274182 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-ea6e44b5-c1ad-4c0e-a0d9-287fce5021cd req-91e9e28e-a798-48c4-8736-95589241a82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b51f5b3-9795-4fb1-ab37-4b0e361dc063", "name": "network-vif-deleted", "tag": "2806b93c-497d-4313-80c4-a9e4b974fc3d"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:50:34.283006 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-ea6e44b5-c1ad-4c0e-a0d9-287fce5021cd req-91e9e28e-a798-48c4-8736-95589241a82c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:34.283455 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-ea6e44b5-c1ad-4c0e-a0d9-287fce5021cd req-91e9e28e-a798-48c4-8736-95589241a82c service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:34.300387 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-ea6e44b5-c1ad-4c0e-a0d9-287fce5021cd req-91e9e28e-a798-48c4-8736-95589241a82c service nova] Creating event network-vif-deleted:2806b93c-497d-4313-80c4-a9e4b974fc3d for instance 0b51f5b3-9795-4fb1-ab37-4b0e361dc063 on hv-cinder-79797 Jul 12 13:50:34.305310 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-ea6e44b5-c1ad-4c0e-a0d9-287fce5021cd req-91e9e28e-a798-48c4-8736-95589241a82c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036227 Jul 12 13:50:34.306575 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 529/1065] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:50:34.641092 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:34.641705 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:34.648460 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:34.649137 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:34.649922 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:34.650386 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:34.683154 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:34.683608 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:34.684063 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lazy-loading 'fault' on Instance uuid 0b51f5b3-9795-4fb1-ab37-4b0e361dc063 {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:50:34.728553 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c30e76da528404d964782e701cefce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8156e0a1827642ef828e8b88343f088d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:50:34.737218 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a8aedfc9-e49e-4bb7-8fe1-65c891255138 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 200 len: 1304 microversion: 2.1 time: 0.099917 Jul 12 13:50:34.737803 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 537/1066] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:34 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:50:35.756350 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d9758d2d-a7e7-4a71-a5cb-f81096e550b6 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:50:35.757055 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d9758d2d-a7e7-4a71-a5cb-f81096e550b6 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] [instance: 0b51f5b3-9795-4fb1-ab37-4b0e361dc063] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:50:35.763272 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d9758d2d-a7e7-4a71-a5cb-f81096e550b6 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:35.763724 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d9758d2d-a7e7-4a71-a5cb-f81096e550b6 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:35.764495 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d9758d2d-a7e7-4a71-a5cb-f81096e550b6 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:50:35.764936 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d9758d2d-a7e7-4a71-a5cb-f81096e550b6 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:50:35.777916 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.wsgi [None req-d9758d2d-a7e7-4a71-a5cb-f81096e550b6 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] HTTP exception thrown: Instance 0b51f5b3-9795-4fb1-ab37-4b0e361dc063 could not be found. Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d9758d2d-a7e7-4a71-a5cb-f81096e550b6 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Request method failure captured: Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: request: GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 HTTP/1.1 Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept: application/json Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Accept-Encoding: identity Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Connection: close Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Length: 0 Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Content-Type: application/json Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Host: 10.222.0.52 Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Openstack-System-Scope: None Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: User-Agent: python-urllib3/1.26.9 Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Auth-Token: gAAAAABizXwZSBY4-InS1de39I4ahe5NExIfv8dUgnQ6kjRn3mHFILLkFe7wC1IPqbYJx8nbaWqoHo0u7mU4KFT_oOW-n9wrLc1x_GMPbmUQqyc36Vx94w5pfIo9LbzXknnHeq9_GuE2pRbtNHk0xVEIkLcgx8QV1-65vIDL795jaLYxBYYp4CI Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Id: None Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Domain-Name: None Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Identity-Status: Confirmed Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Is-Admin-Project: True Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Id: default Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Domain-Name: Default Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Id: 8156e0a1827642ef828e8b88343f088d Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Project-Name: tempest-VolumesNegativeTest-2111994501 Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Role: member,reader Jul 12 13:50:35.779531 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Roles: member,reader Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8156e0a1827642ef828e8b88343f088d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8156e0a1827642ef828e8b88343f088d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8156e0a1827642ef828e8b88343f088d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8156e0a1827642ef828e8b88343f088d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant: tempest-VolumesNegativeTest-2111994501 Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Id: 8156e0a1827642ef828e8b88343f088d Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-Tenant-Name: tempest-VolumesNegativeTest-2111994501 Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User: tempest-VolumesNegativeTest-2111994501-project Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Id: default Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Domain-Name: Default Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Id: 0c30e76da528404d964782e701cefce2 Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: X-User-Name: tempest-VolumesNegativeTest-2111994501-project Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: method: > Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: exception: Instance 0b51f5b3-9795-4fb1-ab37-4b0e361dc063 could not be found. Jul 12 13:50:35.781171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: action_args: {'id': '0b51f5b3-9795-4fb1-ab37-4b0e361dc063'} Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b51f5b3-9795-4fb1-ab37-4b0e361dc063 could not be found. Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:50:35.782249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b51f5b3-9795-4fb1-ab37-4b0e361dc063 could not be found. Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b51f5b3-9795-4fb1-ab37-4b0e361dc063 could not be found. Jul 12 13:50:35.783803 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: ERROR nova.api.openstack.wsgi Jul 12 13:50:35.785164 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d9758d2d-a7e7-4a71-a5cb-f81096e550b6 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] Returning 404 to user: Instance 0b51f5b3-9795-4fb1-ab37-4b0e361dc063 could not be found. {{(pid=124465) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:50:35.785164 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d9758d2d-a7e7-4a71-a5cb-f81096e550b6 tempest-VolumesNegativeTest-2111994501 tempest-VolumesNegativeTest-2111994501-project] 10.222.0.52 "GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063" status: 404 len: 111 microversion: 2.1 time: 0.029652 Jul 12 13:50:35.785164 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 530/1067] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:50:35 2022] GET /compute/v2.1/servers/0b51f5b3-9795-4fb1-ab37-4b0e361dc063 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:51:04.132649 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-a6000c79-39ac-41c3-9036-fd83708c848b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-688576434"}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:51:04.133235 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-a6000c79-39ac-41c3-9036-fd83708c848b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:04.135469 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:04.136110 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=11 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:04.143423 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a6000c79-39ac-41c3-9036-fd83708c848b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:04.143880 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a6000c79-39ac-41c3-9036-fd83708c848b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:04.144656 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a6000c79-39ac-41c3-9036-fd83708c848b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:04.145099 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-a6000c79-39ac-41c3-9036-fd83708c848b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:04.270885 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.network.security_group_api [None req-a6000c79-39ac-41c3-9036-fd83708c848b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Removing security group 6d5d05b1-6e30-4bad-8320-c68932348971 from port 2f35e6cf-0b8f-40d3-bf22-0e4968c53e76 Jul 12 13:51:04.641109 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-a6000c79-39ac-41c3-9036-fd83708c848b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "POST /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/action" status: 202 len: 0 microversion: 2.1 time: 0.512409 Jul 12 13:51:04.642445 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 538/1068] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:51:04 2022] POST /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:51:04.660270 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-e4a2fef7-441e-4ccc-8151-a863a80a6054 req-975e070b-a580-4d8b-a215-af3bbaf8d70d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce9fd72-427a-46b2-99bf-4f5df789bbcc", "tag": "2f35e6cf-0b8f-40d3-bf22-0e4968c53e76"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:51:04.676804 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=35 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:04.677581 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:04.679812 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-e4a2fef7-441e-4ccc-8151-a863a80a6054 req-975e070b-a580-4d8b-a215-af3bbaf8d70d service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:04.680660 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-e4a2fef7-441e-4ccc-8151-a863a80a6054 req-975e070b-a580-4d8b-a215-af3bbaf8d70d service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:04.695991 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-e4a2fef7-441e-4ccc-8151-a863a80a6054 req-975e070b-a580-4d8b-a215-af3bbaf8d70d service nova] Creating event network-changed:2f35e6cf-0b8f-40d3-bf22-0e4968c53e76 for instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc on hv-cinder-79797 Jul 12 13:51:04.702533 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-e4a2fef7-441e-4ccc-8151-a863a80a6054 req-975e070b-a580-4d8b-a215-af3bbaf8d70d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049479 Jul 12 13:51:04.703747 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 531/1069] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:51:05.723800 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-92284361-5cd8-48f3-b8d3-c98a977b15ee tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:05.724309 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-92284361-5cd8-48f3-b8d3-c98a977b15ee tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:05.731006 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92284361-5cd8-48f3-b8d3-c98a977b15ee tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:05.731466 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92284361-5cd8-48f3-b8d3-c98a977b15ee tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:05.732263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92284361-5cd8-48f3-b8d3-c98a977b15ee tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:05.732708 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92284361-5cd8-48f3-b8d3-c98a977b15ee tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:05.733592 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-80b2ba9c-731f-4a86-9132-93fff4d54faf req-ca742f32-7693-4253-bb12-dd84e59bafab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ce9fd72-427a-46b2-99bf-4f5df789bbcc", "tag": "2f35e6cf-0b8f-40d3-bf22-0e4968c53e76"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:51:05.742497 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-80b2ba9c-731f-4a86-9132-93fff4d54faf req-ca742f32-7693-4253-bb12-dd84e59bafab service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:05.743167 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-80b2ba9c-731f-4a86-9132-93fff4d54faf req-ca742f32-7693-4253-bb12-dd84e59bafab service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:05.755345 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-80b2ba9c-731f-4a86-9132-93fff4d54faf req-ca742f32-7693-4253-bb12-dd84e59bafab service nova] Creating event network-changed:2f35e6cf-0b8f-40d3-bf22-0e4968c53e76 for instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc on hv-cinder-79797 Jul 12 13:51:05.761805 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-80b2ba9c-731f-4a86-9132-93fff4d54faf req-ca742f32-7693-4253-bb12-dd84e59bafab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032742 Jul 12 13:51:05.763200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 532/1070] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:51:05.835546 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-92284361-5cd8-48f3-b8d3-c98a977b15ee tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lazy-loading 'services' on Instance uuid 0ce9fd72-427a-46b2-99bf-4f5df789bbcc {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:51:05.937705 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-92284361-5cd8-48f3-b8d3-c98a977b15ee tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments/ba997664-140c-4bea-a1eb-4ec6a4ef3325" status: 202 len: 0 microversion: 2.1 time: 0.218162 Jul 12 13:51:05.938514 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 539/1071] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:51:05 2022] DELETE /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments/ba997664-140c-4bea-a1eb-4ec6a4ef3325 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:51:05.947615 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-82ca4570-5679-4c17-b3e6-d8835662110f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:05.948790 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-82ca4570-5679-4c17-b3e6-d8835662110f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:05.955540 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82ca4570-5679-4c17-b3e6-d8835662110f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:05.956287 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82ca4570-5679-4c17-b3e6-d8835662110f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:05.957295 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82ca4570-5679-4c17-b3e6-d8835662110f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:05.957950 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-82ca4570-5679-4c17-b3e6-d8835662110f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:05.994896 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-82ca4570-5679-4c17-b3e6-d8835662110f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051125 Jul 12 13:51:05.996441 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 533/1072] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:51:05 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:51:07.008549 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-5e714a8d-5a3f-4afa-b0ad-c6a74b43cce7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:07.010221 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-5e714a8d-5a3f-4afa-b0ad-c6a74b43cce7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:07.016433 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e714a8d-5a3f-4afa-b0ad-c6a74b43cce7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:07.016886 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e714a8d-5a3f-4afa-b0ad-c6a74b43cce7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:07.017650 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e714a8d-5a3f-4afa-b0ad-c6a74b43cce7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:07.018123 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-5e714a8d-5a3f-4afa-b0ad-c6a74b43cce7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:07.046613 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-5e714a8d-5a3f-4afa-b0ad-c6a74b43cce7 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042740 Jul 12 13:51:07.047090 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 540/1073] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:51:07 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:51:08.059280 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-600446a0-20ca-4464-bd55-779d79352ed1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:08.060385 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-600446a0-20ca-4464-bd55-779d79352ed1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:08.066949 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-600446a0-20ca-4464-bd55-779d79352ed1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:08.067448 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-600446a0-20ca-4464-bd55-779d79352ed1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:08.068318 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-600446a0-20ca-4464-bd55-779d79352ed1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:08.068855 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-600446a0-20ca-4464-bd55-779d79352ed1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:08.097414 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-600446a0-20ca-4464-bd55-779d79352ed1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042987 Jul 12 13:51:08.097994 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 534/1074] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:51:08 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:51:09.108571 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-9a1a8a82-8e69-46c8-9fbe-90f8bd64431e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:09.109528 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-9a1a8a82-8e69-46c8-9fbe-90f8bd64431e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:09.115952 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a1a8a82-8e69-46c8-9fbe-90f8bd64431e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:09.116408 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a1a8a82-8e69-46c8-9fbe-90f8bd64431e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:09.117174 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a1a8a82-8e69-46c8-9fbe-90f8bd64431e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:09.117613 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-9a1a8a82-8e69-46c8-9fbe-90f8bd64431e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:09.146699 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-9a1a8a82-8e69-46c8-9fbe-90f8bd64431e tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042464 Jul 12 13:51:09.147252 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 541/1075] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:51:09 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:51:10.158256 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bc4c4061-69a0-4726-bf53-c451b994d6de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:10.159197 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bc4c4061-69a0-4726-bf53-c451b994d6de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:10.165654 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bc4c4061-69a0-4726-bf53-c451b994d6de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:10.166135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bc4c4061-69a0-4726-bf53-c451b994d6de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:10.166896 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bc4c4061-69a0-4726-bf53-c451b994d6de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:10.167331 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bc4c4061-69a0-4726-bf53-c451b994d6de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:10.194098 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bc4c4061-69a0-4726-bf53-c451b994d6de tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039774 Jul 12 13:51:10.194641 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 535/1076] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Jul 12 13:51:10 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 13:51:10.204791 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-827eedfa-3502-4d38-b1ba-c3c7f196e05a tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:10.205273 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-827eedfa-3502-4d38-b1ba-c3c7f196e05a tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:10.211653 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-827eedfa-3502-4d38-b1ba-c3c7f196e05a tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:10.212803 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-827eedfa-3502-4d38-b1ba-c3c7f196e05a tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:10.213558 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-827eedfa-3502-4d38-b1ba-c3c7f196e05a tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:10.214074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-827eedfa-3502-4d38-b1ba-c3c7f196e05a tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:10.287601 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-827eedfa-3502-4d38-b1ba-c3c7f196e05a tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] HTTP exception thrown: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc is not attached to volume ba997664-140c-4bea-a1eb-4ec6a4ef3325 Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-827eedfa-3502-4d38-b1ba-c3c7f196e05a tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Request method failure captured: Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: DELETE /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments/ba997664-140c-4bea-a1eb-4ec6a4ef3325 HTTP/1.1 Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXuwqOmBBAK6r-oOZ4l786VrTKUIqYlyqoO2BAIHGPqlce-oegY6VP9DEleyCnuB2SzSI-yIHUfEUF3sSdFN9pp-eT_LZkfNFyK4gBF1026RwbAom9pt-QeD9-5W_6uAcBpeUA7AcUD-BCBBxazvTcUzXWblvBJjTQOXBB1ZWtgHCuM Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 70562708174846e9bb7b1b128a629a98 Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-TestMinimumBasicScenario-1565343480 Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:51:10.299541 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/70562708174846e9bb7b1b128a629a98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/70562708174846e9bb7b1b128a629a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/70562708174846e9bb7b1b128a629a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_70562708174846e9bb7b1b128a629a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-TestMinimumBasicScenario-1565343480 Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 70562708174846e9bb7b1b128a629a98 Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1565343480 Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-TestMinimumBasicScenario-1565343480-project Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: ab68f09ccf4d4ac9901d4ed792b551c0 Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-TestMinimumBasicScenario-1565343480-project Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:51:10.301188 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc is not attached to volume ba997664-140c-4bea-a1eb-4ec6a4ef3325 Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'server_id': '0ce9fd72-427a-46b2-99bf-4f5df789bbcc', 'id': 'ba997664-140c-4bea-a1eb-4ec6a4ef3325'} Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ba997664-140c-4bea-a1eb-4ec6a4ef3325. Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:51:10.302183 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc is not attached to volume ba997664-140c-4bea-a1eb-4ec6a4ef3325 Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc is not attached to volume ba997664-140c-4bea-a1eb-4ec6a4ef3325 Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:51:10.303739 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-827eedfa-3502-4d38-b1ba-c3c7f196e05a tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Returning 404 to user: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc is not attached to volume ba997664-140c-4bea-a1eb-4ec6a4ef3325 {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:51:10.305436 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-827eedfa-3502-4d38-b1ba-c3c7f196e05a tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments/ba997664-140c-4bea-a1eb-4ec6a4ef3325" status: 404 len: 154 microversion: 2.1 time: 0.100246 Jul 12 13:51:10.305436 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 542/1077] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Jul 12 13:51:10 2022] DELETE /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc/os-volume_attachments/ba997664-140c-4bea-a1eb-4ec6a4ef3325 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:51:11.434791 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-4c6cc3eb-b0d1-4004-bfa4-da9c4ca484d3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:11.435273 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4c6cc3eb-b0d1-4004-bfa4-da9c4ca484d3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:11.441666 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4c6cc3eb-b0d1-4004-bfa4-da9c4ca484d3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:11.442166 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4c6cc3eb-b0d1-4004-bfa4-da9c4ca484d3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:11.442931 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4c6cc3eb-b0d1-4004-bfa4-da9c4ca484d3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:11.443370 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-4c6cc3eb-b0d1-4004-bfa4-da9c4ca484d3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:11.468714 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-4c6cc3eb-b0d1-4004-bfa4-da9c4ca484d3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:51:11.551557 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-4c6cc3eb-b0d1-4004-bfa4-da9c4ca484d3 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 204 len: 0 microversion: 2.1 time: 0.119973 Jul 12 13:51:11.552177 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 536/1078] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:51:11 2022] DELETE /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:51:11.560916 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-b8397158-2e09-4688-9c9c-05cdfc70e74f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:11.561574 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-b8397158-2e09-4688-9c9c-05cdfc70e74f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:11.568277 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b8397158-2e09-4688-9c9c-05cdfc70e74f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:11.568754 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b8397158-2e09-4688-9c9c-05cdfc70e74f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:11.569504 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b8397158-2e09-4688-9c9c-05cdfc70e74f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:11.569944 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-b8397158-2e09-4688-9c9c-05cdfc70e74f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:11.698374 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-b8397158-2e09-4688-9c9c-05cdfc70e74f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:51:11.705848 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-b8397158-2e09-4688-9c9c-05cdfc70e74f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1554 microversion: 2.1 time: 0.148846 Jul 12 13:51:11.706441 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 543/1079] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:51:11 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:51:12.724526 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d153a9cb-26c8-4606-94a5-cc66f2a22fb1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:12.725290 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d153a9cb-26c8-4606-94a5-cc66f2a22fb1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:12.732388 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d153a9cb-26c8-4606-94a5-cc66f2a22fb1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:12.732846 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d153a9cb-26c8-4606-94a5-cc66f2a22fb1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:12.733612 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d153a9cb-26c8-4606-94a5-cc66f2a22fb1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:12.734092 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d153a9cb-26c8-4606-94a5-cc66f2a22fb1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:12.862868 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d153a9cb-26c8-4606-94a5-cc66f2a22fb1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:51:12.870988 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d153a9cb-26c8-4606-94a5-cc66f2a22fb1 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1554 microversion: 2.1 time: 0.150760 Jul 12 13:51:12.871549 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 537/1080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:51:12 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 13:51:13.686490 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-b1bf2b76-996b-4428-9057-e1fd93e1bf85 req-e550d045-b94a-484e-8612-dacd7e7c2757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ce9fd72-427a-46b2-99bf-4f5df789bbcc", "name": "network-vif-deleted", "tag": "2f35e6cf-0b8f-40d3-bf22-0e4968c53e76"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:51:13.697196 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b1bf2b76-996b-4428-9057-e1fd93e1bf85 req-e550d045-b94a-484e-8612-dacd7e7c2757 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:13.697652 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-b1bf2b76-996b-4428-9057-e1fd93e1bf85 req-e550d045-b94a-484e-8612-dacd7e7c2757 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:13.709586 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-b1bf2b76-996b-4428-9057-e1fd93e1bf85 req-e550d045-b94a-484e-8612-dacd7e7c2757 service nova] Creating event network-vif-deleted:2f35e6cf-0b8f-40d3-bf22-0e4968c53e76 for instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc on hv-cinder-79797 Jul 12 13:51:13.716040 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-b1bf2b76-996b-4428-9057-e1fd93e1bf85 req-e550d045-b94a-484e-8612-dacd7e7c2757 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033319 Jul 12 13:51:13.716727 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 544/1081] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:51:13.888988 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:13.889664 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:13.896467 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:13.897057 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:13.897878 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:13.898342 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:13.928013 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:13.928453 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:13.928897 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.objects.instance [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lazy-loading 'fault' on Instance uuid 0ce9fd72-427a-46b2-99bf-4f5df789bbcc {{(pid=124465) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:51:13.969768 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab68f09ccf4d4ac9901d4ed792b551c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70562708174846e9bb7b1b128a629a98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:51:13.977567 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-39bbd465-09cd-4a90-913f-bb37afdc7a6b tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 200 len: 1348 microversion: 2.1 time: 0.092641 Jul 12 13:51:13.978171 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 538/1082] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:51:13 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:51:14.997083 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e4382048-f81c-4c52-b806-909751dc2db5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:14.997697 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-e4382048-f81c-4c52-b806-909751dc2db5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] [instance: 0ce9fd72-427a-46b2-99bf-4f5df789bbcc] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:51:15.004813 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e4382048-f81c-4c52-b806-909751dc2db5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:15.005262 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e4382048-f81c-4c52-b806-909751dc2db5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:15.006068 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e4382048-f81c-4c52-b806-909751dc2db5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:51:15.006494 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-e4382048-f81c-4c52-b806-909751dc2db5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:51:15.019266 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-e4382048-f81c-4c52-b806-909751dc2db5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] HTTP exception thrown: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc could not be found. Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e4382048-f81c-4c52-b806-909751dc2db5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Request method failure captured: Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc HTTP/1.1 Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXuwqOmBBAK6r-oOZ4l786VrTKUIqYlyqoO2BAIHGPqlce-oegY6VP9DEleyCnuB2SzSI-yIHUfEUF3sSdFN9pp-eT_LZkfNFyK4gBF1026RwbAom9pt-QeD9-5W_6uAcBpeUA7AcUD-BCBBxazvTcUzXWblvBJjTQOXBB1ZWtgHCuM Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: 70562708174846e9bb7b1b128a629a98 Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-TestMinimumBasicScenario-1565343480 Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:51:15.020860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/70562708174846e9bb7b1b128a629a98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/70562708174846e9bb7b1b128a629a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/70562708174846e9bb7b1b128a629a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_70562708174846e9bb7b1b128a629a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-TestMinimumBasicScenario-1565343480 Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: 70562708174846e9bb7b1b128a629a98 Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1565343480 Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-TestMinimumBasicScenario-1565343480-project Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: ab68f09ccf4d4ac9901d4ed792b551c0 Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-TestMinimumBasicScenario-1565343480-project Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc could not be found. Jul 12 13:51:15.022695 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '0ce9fd72-427a-46b2-99bf-4f5df789bbcc'} Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc could not be found. Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:51:15.023688 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc could not be found. Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc could not be found. Jul 12 13:51:15.025841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:51:15.027357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-e4382048-f81c-4c52-b806-909751dc2db5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Returning 404 to user: Instance 0ce9fd72-427a-46b2-99bf-4f5df789bbcc could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:51:15.027357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-e4382048-f81c-4c52-b806-909751dc2db5 tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc" status: 404 len: 111 microversion: 2.1 time: 0.029522 Jul 12 13:51:15.027357 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 545/1083] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:51:14 2022] GET /compute/v2.1/servers/0ce9fd72-427a-46b2-99bf-4f5df789bbcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:51:15.032734 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-f6187e5b-1e51-416c-8592-2d7a53074b2f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] Calling method '.version_select at 0x7f3a15cc4670>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:51:15.051468 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-f6187e5b-1e51-416c-8592-2d7a53074b2f tempest-TestMinimumBasicScenario-1565343480 tempest-TestMinimumBasicScenario-1565343480-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1995291148" status: 202 len: 0 microversion: 2.1 time: 0.022611 Jul 12 13:51:15.052043 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 539/1084] 10.222.0.52 () {58 vars in 1271 bytes} [Tue Jul 12 13:51:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1995291148 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:52:02.249154 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-56ebd51b-eea4-4dd5-8ff9-671ac6d572b7 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:52:02.249733 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-56ebd51b-eea4-4dd5-8ff9-671ac6d572b7 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:02.252354 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=16 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:02.252974 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:02.258731 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-56ebd51b-eea4-4dd5-8ff9-671ac6d572b7 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:02.259178 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-56ebd51b-eea4-4dd5-8ff9-671ac6d572b7 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:02.259932 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-56ebd51b-eea4-4dd5-8ff9-671ac6d572b7 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:02.260367 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-56ebd51b-eea4-4dd5-8ff9-671ac6d572b7 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:02.283395 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.objects.instance [None req-56ebd51b-eea4-4dd5-8ff9-671ac6d572b7 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lazy-loading 'flavor' on Instance uuid 5c9ed0f9-c449-4b4a-8440-a199c233faee {{(pid=124466) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 13:52:02.352306 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-56ebd51b-eea4-4dd5-8ff9-671ac6d572b7 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "POST /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee/action" status: 202 len: 0 microversion: 2.1 time: 0.106810 Jul 12 13:52:02.352883 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 546/1085] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:52:02 2022] POST /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:52:02.361793 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3b9e34f4-0b48-4ab0-bac3-80562be537b0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:02.362425 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3b9e34f4-0b48-4ab0-bac3-80562be537b0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:02.364658 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:02.365422 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:02.371673 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3b9e34f4-0b48-4ab0-bac3-80562be537b0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:02.372158 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3b9e34f4-0b48-4ab0-bac3-80562be537b0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:02.372870 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3b9e34f4-0b48-4ab0-bac3-80562be537b0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:02.373300 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3b9e34f4-0b48-4ab0-bac3-80562be537b0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:02.663425 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-3b9e34f4-0b48-4ab0-bac3-80562be537b0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:02.671176 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3b9e34f4-0b48-4ab0-bac3-80562be537b0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.313352 Jul 12 13:52:02.671819 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 540/1086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:02 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:03.500936 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:52:03.501503 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Tue Jul 12 13:52:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:52:03.690339 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-f2341577-0e06-4cc8-aaf3-2125aafd451e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:03.691052 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-f2341577-0e06-4cc8-aaf3-2125aafd451e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:03.698040 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f2341577-0e06-4cc8-aaf3-2125aafd451e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:03.698495 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f2341577-0e06-4cc8-aaf3-2125aafd451e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:03.699845 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f2341577-0e06-4cc8-aaf3-2125aafd451e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:03.700283 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-f2341577-0e06-4cc8-aaf3-2125aafd451e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:03.882247 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-f2341577-0e06-4cc8-aaf3-2125aafd451e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:03.891474 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-f2341577-0e06-4cc8-aaf3-2125aafd451e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.205774 Jul 12 13:52:03.892037 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 547/1087] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:03 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:04.908850 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-94dd92e8-1513-43a8-88d3-83b120d6a213 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:04.909394 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-94dd92e8-1513-43a8-88d3-83b120d6a213 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:04.916069 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-94dd92e8-1513-43a8-88d3-83b120d6a213 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:04.916526 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-94dd92e8-1513-43a8-88d3-83b120d6a213 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:04.917340 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-94dd92e8-1513-43a8-88d3-83b120d6a213 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:04.917780 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-94dd92e8-1513-43a8-88d3-83b120d6a213 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:05.046057 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-94dd92e8-1513-43a8-88d3-83b120d6a213 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:05.054344 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-94dd92e8-1513-43a8-88d3-83b120d6a213 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.149375 Jul 12 13:52:05.054927 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 541/1088] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:04 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:06.071958 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3dccdec6-bb74-4476-b001-e29c983656d0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:06.072576 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3dccdec6-bb74-4476-b001-e29c983656d0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:06.079167 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3dccdec6-bb74-4476-b001-e29c983656d0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:06.079622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3dccdec6-bb74-4476-b001-e29c983656d0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:06.080389 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3dccdec6-bb74-4476-b001-e29c983656d0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:06.080831 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3dccdec6-bb74-4476-b001-e29c983656d0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:06.210128 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-3dccdec6-bb74-4476-b001-e29c983656d0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:06.218497 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3dccdec6-bb74-4476-b001-e29c983656d0 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.150426 Jul 12 13:52:06.219064 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 548/1089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:06 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:07.234910 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-c5f5f81d-ceb8-4c1d-8f92-6ff519fb45af tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:07.235521 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-c5f5f81d-ceb8-4c1d-8f92-6ff519fb45af tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:07.242040 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c5f5f81d-ceb8-4c1d-8f92-6ff519fb45af tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:07.242494 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c5f5f81d-ceb8-4c1d-8f92-6ff519fb45af tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:07.243258 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c5f5f81d-ceb8-4c1d-8f92-6ff519fb45af tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:07.243698 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-c5f5f81d-ceb8-4c1d-8f92-6ff519fb45af tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:07.374767 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-c5f5f81d-ceb8-4c1d-8f92-6ff519fb45af tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:07.382563 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-c5f5f81d-ceb8-4c1d-8f92-6ff519fb45af tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.151525 Jul 12 13:52:07.383130 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 542/1090] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:07 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:08.400381 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-92b1c30a-c276-40eb-970a-71fe2af2c216 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:08.401013 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-92b1c30a-c276-40eb-970a-71fe2af2c216 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:08.408273 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92b1c30a-c276-40eb-970a-71fe2af2c216 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:08.408859 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92b1c30a-c276-40eb-970a-71fe2af2c216 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:08.409627 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92b1c30a-c276-40eb-970a-71fe2af2c216 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:08.410095 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-92b1c30a-c276-40eb-970a-71fe2af2c216 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:08.544308 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-92b1c30a-c276-40eb-970a-71fe2af2c216 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:08.551726 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-92b1c30a-c276-40eb-970a-71fe2af2c216 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.155194 Jul 12 13:52:08.552286 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 549/1091] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:08 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:09.563150 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:52:09.563720 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Tue Jul 12 13:52:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:52:09.570859 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-bf5a2f73-f9ff-460b-994a-7f06f9f53dbb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:09.572207 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-bf5a2f73-f9ff-460b-994a-7f06f9f53dbb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:09.580289 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf5a2f73-f9ff-460b-994a-7f06f9f53dbb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:09.580739 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf5a2f73-f9ff-460b-994a-7f06f9f53dbb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:09.581501 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf5a2f73-f9ff-460b-994a-7f06f9f53dbb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:09.581937 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-bf5a2f73-f9ff-460b-994a-7f06f9f53dbb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:09.712377 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-bf5a2f73-f9ff-460b-994a-7f06f9f53dbb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:09.719808 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-bf5a2f73-f9ff-460b-994a-7f06f9f53dbb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.153425 Jul 12 13:52:09.720361 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 543/1092] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:09 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:10.737057 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-7921f826-c97c-4184-af21-ebe1c6188a6a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:10.737667 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-7921f826-c97c-4184-af21-ebe1c6188a6a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:10.744246 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7921f826-c97c-4184-af21-ebe1c6188a6a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:10.744699 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7921f826-c97c-4184-af21-ebe1c6188a6a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:10.746132 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7921f826-c97c-4184-af21-ebe1c6188a6a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:10.746575 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-7921f826-c97c-4184-af21-ebe1c6188a6a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:10.876612 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-7921f826-c97c-4184-af21-ebe1c6188a6a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:10.884270 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-7921f826-c97c-4184-af21-ebe1c6188a6a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.151097 Jul 12 13:52:10.884860 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 550/1093] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:10 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:11.900499 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-225362cd-718e-4123-aca7-8ad8b23e7ef3 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:11.901135 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-225362cd-718e-4123-aca7-8ad8b23e7ef3 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:11.908200 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-225362cd-718e-4123-aca7-8ad8b23e7ef3 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:11.908645 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-225362cd-718e-4123-aca7-8ad8b23e7ef3 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:11.909397 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-225362cd-718e-4123-aca7-8ad8b23e7ef3 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:11.909826 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-225362cd-718e-4123-aca7-8ad8b23e7ef3 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:12.042509 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-225362cd-718e-4123-aca7-8ad8b23e7ef3 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:12.049894 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-225362cd-718e-4123-aca7-8ad8b23e7ef3 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.153214 Jul 12 13:52:12.050474 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 544/1094] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:11 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:13.067562 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6c055ca1-3f79-441b-bb8f-95e24b76ae27 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:13.068252 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6c055ca1-3f79-441b-bb8f-95e24b76ae27 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:13.074915 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c055ca1-3f79-441b-bb8f-95e24b76ae27 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:13.075358 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c055ca1-3f79-441b-bb8f-95e24b76ae27 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:13.076114 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c055ca1-3f79-441b-bb8f-95e24b76ae27 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:13.076545 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6c055ca1-3f79-441b-bb8f-95e24b76ae27 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:13.208845 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6c055ca1-3f79-441b-bb8f-95e24b76ae27 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:13.216414 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6c055ca1-3f79-441b-bb8f-95e24b76ae27 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.152806 Jul 12 13:52:13.216981 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 551/1095] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:13 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:14.233478 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-222c14a2-a693-4cc9-8a75-f0e918400d8d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:14.234124 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-222c14a2-a693-4cc9-8a75-f0e918400d8d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:14.240939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-222c14a2-a693-4cc9-8a75-f0e918400d8d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:14.241449 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-222c14a2-a693-4cc9-8a75-f0e918400d8d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:14.242247 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-222c14a2-a693-4cc9-8a75-f0e918400d8d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:14.242681 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-222c14a2-a693-4cc9-8a75-f0e918400d8d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:14.374634 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-222c14a2-a693-4cc9-8a75-f0e918400d8d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:14.382424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-222c14a2-a693-4cc9-8a75-f0e918400d8d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.153394 Jul 12 13:52:14.382986 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 545/1096] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:14 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:15.400009 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-4b53d317-9ca5-4106-802f-ba2bb26e996d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:15.400593 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-4b53d317-9ca5-4106-802f-ba2bb26e996d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:15.407689 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b53d317-9ca5-4106-802f-ba2bb26e996d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:15.408137 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b53d317-9ca5-4106-802f-ba2bb26e996d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:15.408896 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b53d317-9ca5-4106-802f-ba2bb26e996d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:15.409325 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-4b53d317-9ca5-4106-802f-ba2bb26e996d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:15.535921 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-4b53d317-9ca5-4106-802f-ba2bb26e996d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:15.543369 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-4b53d317-9ca5-4106-802f-ba2bb26e996d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1509 microversion: 2.1 time: 0.147243 Jul 12 13:52:15.543917 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 552/1097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:15 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:15.559824 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-27677988-6cf5-4c1a-a306-a474622ffe50 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:52:15.560396 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-27677988-6cf5-4c1a-a306-a474622ffe50 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:15.566880 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-27677988-6cf5-4c1a-a306-a474622ffe50 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:15.567329 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-27677988-6cf5-4c1a-a306-a474622ffe50 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:15.568086 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-27677988-6cf5-4c1a-a306-a474622ffe50 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:15.568520 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-27677988-6cf5-4c1a-a306-a474622ffe50 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:15.641598 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-27677988-6cf5-4c1a-a306-a474622ffe50 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "POST /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee/action" status: 202 len: 0 microversion: 2.1 time: 0.086134 Jul 12 13:52:15.642228 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 546/1098] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Jul 12 13:52:15 2022] POST /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:52:15.650363 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-fea6ceb1-409f-4d9b-925e-e779be3cc3a1 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:15.651506 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-fea6ceb1-409f-4d9b-925e-e779be3cc3a1 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:15.661498 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fea6ceb1-409f-4d9b-925e-e779be3cc3a1 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:15.662010 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fea6ceb1-409f-4d9b-925e-e779be3cc3a1 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:15.662738 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fea6ceb1-409f-4d9b-925e-e779be3cc3a1 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:15.663175 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-fea6ceb1-409f-4d9b-925e-e779be3cc3a1 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:15.796486 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-fea6ceb1-409f-4d9b-925e-e779be3cc3a1 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:15.804258 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-fea6ceb1-409f-4d9b-925e-e779be3cc3a1 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1517 microversion: 2.1 time: 0.157764 Jul 12 13:52:15.804822 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 553/1099] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:15 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:16.822823 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-56b3fc90-511b-4e2e-8d7f-ec14354cf40d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:16.823458 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-56b3fc90-511b-4e2e-8d7f-ec14354cf40d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:16.829452 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-56b3fc90-511b-4e2e-8d7f-ec14354cf40d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:16.829904 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-56b3fc90-511b-4e2e-8d7f-ec14354cf40d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:16.830698 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-56b3fc90-511b-4e2e-8d7f-ec14354cf40d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:16.831141 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-56b3fc90-511b-4e2e-8d7f-ec14354cf40d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:16.970162 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-56b3fc90-511b-4e2e-8d7f-ec14354cf40d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:16.978669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-56b3fc90-511b-4e2e-8d7f-ec14354cf40d tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1575 microversion: 2.1 time: 0.160415 Jul 12 13:52:16.979781 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 547/1100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:16 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:17.997199 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-55a3c8da-20ca-41a9-8c93-6096fe91ab7a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:17.997806 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-55a3c8da-20ca-41a9-8c93-6096fe91ab7a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:18.006287 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-55a3c8da-20ca-41a9-8c93-6096fe91ab7a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:18.006740 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-55a3c8da-20ca-41a9-8c93-6096fe91ab7a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:18.007530 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-55a3c8da-20ca-41a9-8c93-6096fe91ab7a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:18.007971 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-55a3c8da-20ca-41a9-8c93-6096fe91ab7a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:18.137730 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-55a3c8da-20ca-41a9-8c93-6096fe91ab7a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:18.145274 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-55a3c8da-20ca-41a9-8c93-6096fe91ab7a tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1575 microversion: 2.1 time: 0.152474 Jul 12 13:52:18.145841 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 554/1101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:17 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:18.231946 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [req-55d16cbe-8b4c-405f-a0c6-6f748f23c937 req-d6f8f1d2-cc03-4dbd-bd6d-022221b41195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9ed0f9-c449-4b4a-8440-a199c233faee", "name": "network-vif-unplugged", "status": "completed", "tag": "6cc8dd65-f30a-4319-b999-92912807ff2e"}]} {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:52:18.242934 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-55d16cbe-8b4c-405f-a0c6-6f748f23c937 req-d6f8f1d2-cc03-4dbd-bd6d-022221b41195 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:18.243404 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [req-55d16cbe-8b4c-405f-a0c6-6f748f23c937 req-d6f8f1d2-cc03-4dbd-bd6d-022221b41195 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:18.255318 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.compute.server_external_events [req-55d16cbe-8b4c-405f-a0c6-6f748f23c937 req-d6f8f1d2-cc03-4dbd-bd6d-022221b41195 service nova] Creating event network-vif-unplugged:6cc8dd65-f30a-4319-b999-92912807ff2e for instance 5c9ed0f9-c449-4b4a-8440-a199c233faee on hv-cinder-79797 Jul 12 13:52:18.260558 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [req-55d16cbe-8b4c-405f-a0c6-6f748f23c937 req-d6f8f1d2-cc03-4dbd-bd6d-022221b41195 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033447 Jul 12 13:52:18.261145 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 548/1102] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:52:19.162341 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-df3f700e-29b9-431e-ad85-7c4b3e695cda tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:19.162943 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-df3f700e-29b9-431e-ad85-7c4b3e695cda tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:19.169463 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df3f700e-29b9-431e-ad85-7c4b3e695cda tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:19.169908 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df3f700e-29b9-431e-ad85-7c4b3e695cda tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:19.170687 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df3f700e-29b9-431e-ad85-7c4b3e695cda tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:19.171119 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-df3f700e-29b9-431e-ad85-7c4b3e695cda tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:19.303996 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-df3f700e-29b9-431e-ad85-7c4b3e695cda tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:19.311912 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-df3f700e-29b9-431e-ad85-7c4b3e695cda tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1575 microversion: 2.1 time: 0.153409 Jul 12 13:52:19.312473 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 555/1103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:19 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:20.329424 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-d334353a-0375-49e5-97ff-f448f934ebab tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:20.330415 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-d334353a-0375-49e5-97ff-f448f934ebab tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:20.337070 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d334353a-0375-49e5-97ff-f448f934ebab tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:20.337519 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d334353a-0375-49e5-97ff-f448f934ebab tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:20.338350 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d334353a-0375-49e5-97ff-f448f934ebab tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:20.338778 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-d334353a-0375-49e5-97ff-f448f934ebab tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:20.467249 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-d334353a-0375-49e5-97ff-f448f934ebab tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:20.474719 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-d334353a-0375-49e5-97ff-f448f934ebab tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1575 microversion: 2.1 time: 0.149501 Jul 12 13:52:20.475291 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 549/1104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:20 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:21.491703 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-6351dbab-4651-4899-83b6-f9a5ed80de51 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:21.492292 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-6351dbab-4651-4899-83b6-f9a5ed80de51 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:21.499482 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6351dbab-4651-4899-83b6-f9a5ed80de51 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:21.499936 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6351dbab-4651-4899-83b6-f9a5ed80de51 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:21.500700 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6351dbab-4651-4899-83b6-f9a5ed80de51 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:21.501147 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-6351dbab-4651-4899-83b6-f9a5ed80de51 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:21.628409 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-6351dbab-4651-4899-83b6-f9a5ed80de51 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:21.635779 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-6351dbab-4651-4899-83b6-f9a5ed80de51 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1575 microversion: 2.1 time: 0.147994 Jul 12 13:52:21.636343 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 556/1105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:21 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:22.653156 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-e57aaba0-3ce7-4bc0-b907-38df7928650e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:22.653776 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-e57aaba0-3ce7-4bc0-b907-38df7928650e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:22.660462 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e57aaba0-3ce7-4bc0-b907-38df7928650e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:22.660910 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e57aaba0-3ce7-4bc0-b907-38df7928650e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:22.661669 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e57aaba0-3ce7-4bc0-b907-38df7928650e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:22.662215 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-e57aaba0-3ce7-4bc0-b907-38df7928650e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:22.795788 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-e57aaba0-3ce7-4bc0-b907-38df7928650e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:22.803350 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-e57aaba0-3ce7-4bc0-b907-38df7928650e tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1575 microversion: 2.1 time: 0.154619 Jul 12 13:52:22.803917 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 550/1106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:22 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:23.820616 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-83f2708c-eec1-4833-95b8-4ba2b7d4a2bb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:23.821259 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-83f2708c-eec1-4833-95b8-4ba2b7d4a2bb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:23.827854 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83f2708c-eec1-4833-95b8-4ba2b7d4a2bb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:23.828309 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83f2708c-eec1-4833-95b8-4ba2b7d4a2bb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:23.829074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83f2708c-eec1-4833-95b8-4ba2b7d4a2bb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:23.829512 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-83f2708c-eec1-4833-95b8-4ba2b7d4a2bb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:23.961638 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-83f2708c-eec1-4833-95b8-4ba2b7d4a2bb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:23.969616 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-83f2708c-eec1-4833-95b8-4ba2b7d4a2bb tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1575 microversion: 2.1 time: 0.152902 Jul 12 13:52:23.970213 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 557/1107] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:23 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:24.986197 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8f906a37-5e46-4cc9-a430-85de37d7ee39 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:52:24.986845 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8f906a37-5e46-4cc9-a430-85de37d7ee39 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:52:24.992939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8f906a37-5e46-4cc9-a430-85de37d7ee39 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:24.993384 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8f906a37-5e46-4cc9-a430-85de37d7ee39 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:24.994156 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8f906a37-5e46-4cc9-a430-85de37d7ee39 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:24.994585 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8f906a37-5e46-4cc9-a430-85de37d7ee39 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:25.121763 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8f906a37-5e46-4cc9-a430-85de37d7ee39 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:52:25.129482 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8f906a37-5e46-4cc9-a430-85de37d7ee39 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1562 microversion: 2.1 time: 0.147312 Jul 12 13:52:25.130055 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 551/1108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:52:24 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:52:28.455744 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-56c35559-8a0d-4363-9006-a41bcde9a20b req-45b7cffe-a7a1-4958-9b8f-85053d117e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9ed0f9-c449-4b4a-8440-a199c233faee", "name": "network-vif-plugged", "status": "completed", "tag": "6cc8dd65-f30a-4319-b999-92912807ff2e"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:52:28.464734 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-56c35559-8a0d-4363-9006-a41bcde9a20b req-45b7cffe-a7a1-4958-9b8f-85053d117e47 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:52:28.465668 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-56c35559-8a0d-4363-9006-a41bcde9a20b req-45b7cffe-a7a1-4958-9b8f-85053d117e47 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:52:28.480211 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-56c35559-8a0d-4363-9006-a41bcde9a20b req-45b7cffe-a7a1-4958-9b8f-85053d117e47 service nova] Creating event network-vif-plugged:6cc8dd65-f30a-4319-b999-92912807ff2e for instance 5c9ed0f9-c449-4b4a-8440-a199c233faee on hv-cinder-79797 Jul 12 13:52:28.485899 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-56c35559-8a0d-4363-9006-a41bcde9a20b req-45b7cffe-a7a1-4958-9b8f-85053d117e47 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034410 Jul 12 13:52:28.486836 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 558/1109] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:53:41.535414 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_api:SELECT=26 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:53:41.536405 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG dbcounter [-] [124465] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:53:41.538280 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_api:SELECT=26 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:53:41.539995 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG dbcounter [-] [124466] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:53:41.541256 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-3f13343c-c579-4fe0-9833-e919d62aa54c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:53:41.541864 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3f13343c-c579-4fe0-9833-e919d62aa54c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:53:41.550229 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f13343c-c579-4fe0-9833-e919d62aa54c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:41.551254 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f13343c-c579-4fe0-9833-e919d62aa54c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:41.552110 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f13343c-c579-4fe0-9833-e919d62aa54c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:41.552930 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-3f13343c-c579-4fe0-9833-e919d62aa54c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:41.581416 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-3f13343c-c579-4fe0-9833-e919d62aa54c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Going to try to terminate instance {{(pid=124465) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 13:53:41.613145 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-0003a4a6-96fe-463a-9b76-e69efa9a22c3 req-35bbc958-7a63-41cf-af9f-c722c00e9475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9ed0f9-c449-4b4a-8440-a199c233faee", "tag": "6cc8dd65-f30a-4319-b999-92912807ff2e"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:53:41.622648 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-0003a4a6-96fe-463a-9b76-e69efa9a22c3 req-35bbc958-7a63-41cf-af9f-c722c00e9475 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:41.623249 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-0003a4a6-96fe-463a-9b76-e69efa9a22c3 req-35bbc958-7a63-41cf-af9f-c722c00e9475 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:41.635935 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-0003a4a6-96fe-463a-9b76-e69efa9a22c3 req-35bbc958-7a63-41cf-af9f-c722c00e9475 service nova] Creating event network-changed:6cc8dd65-f30a-4319-b999-92912807ff2e for instance 5c9ed0f9-c449-4b4a-8440-a199c233faee on hv-cinder-79797 Jul 12 13:53:41.642069 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-0003a4a6-96fe-463a-9b76-e69efa9a22c3 req-35bbc958-7a63-41cf-af9f-c722c00e9475 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106269 Jul 12 13:53:41.643423 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 559/1110] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 13:53:41.669460 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-3f13343c-c579-4fe0-9833-e919d62aa54c tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 204 len: 0 microversion: 2.1 time: 0.134530 Jul 12 13:53:41.670350 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 552/1111] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Jul 12 13:53:41 2022] DELETE /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 13:53:41.682681 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-ed1a44d2-2450-4521-9b36-3615b391807b tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:53:41.683751 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-ed1a44d2-2450-4521-9b36-3615b391807b tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:53:41.692514 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ed1a44d2-2450-4521-9b36-3615b391807b tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:41.693027 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ed1a44d2-2450-4521-9b36-3615b391807b tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:41.694162 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ed1a44d2-2450-4521-9b36-3615b391807b tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:41.694761 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-ed1a44d2-2450-4521-9b36-3615b391807b tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:41.840686 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.policy [None req-ed1a44d2-2450-4521-9b36-3615b391807b tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124466) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:53:41.849319 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-ed1a44d2-2450-4521-9b36-3615b391807b tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.173397 Jul 12 13:53:41.850003 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 560/1112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:53:41 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:53:42.867236 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-8b7ed050-a6d9-4d74-8d78-50bcf132c478 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:53:42.867939 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-8b7ed050-a6d9-4d74-8d78-50bcf132c478 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:53:42.875016 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8b7ed050-a6d9-4d74-8d78-50bcf132c478 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:42.876060 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8b7ed050-a6d9-4d74-8d78-50bcf132c478 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:42.876840 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8b7ed050-a6d9-4d74-8d78-50bcf132c478 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:42.877281 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-8b7ed050-a6d9-4d74-8d78-50bcf132c478 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:43.018954 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-8b7ed050-a6d9-4d74-8d78-50bcf132c478 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:53:43.026500 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-8b7ed050-a6d9-4d74-8d78-50bcf132c478 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1568 microversion: 2.1 time: 0.163509 Jul 12 13:53:43.027070 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 553/1113] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:53:42 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:53:43.817820 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [req-8ed314d9-617d-44a4-b757-2dd00c5cbc64 req-27ee2180-811b-4aeb-8b40-0b2bd8428654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9ed0f9-c449-4b4a-8440-a199c233faee", "name": "network-vif-deleted", "tag": "6cc8dd65-f30a-4319-b999-92912807ff2e"}]} {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 13:53:43.826168 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-8ed314d9-617d-44a4-b757-2dd00c5cbc64 req-27ee2180-811b-4aeb-8b40-0b2bd8428654 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:43.826611 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [req-8ed314d9-617d-44a4-b757-2dd00c5cbc64 req-27ee2180-811b-4aeb-8b40-0b2bd8428654 service nova] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:43.838646 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.compute.server_external_events [req-8ed314d9-617d-44a4-b757-2dd00c5cbc64 req-27ee2180-811b-4aeb-8b40-0b2bd8428654 service nova] Creating event network-vif-deleted:6cc8dd65-f30a-4319-b999-92912807ff2e for instance 5c9ed0f9-c449-4b4a-8440-a199c233faee on hv-cinder-79797 Jul 12 13:53:43.843409 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [req-8ed314d9-617d-44a4-b757-2dd00c5cbc64 req-27ee2180-811b-4aeb-8b40-0b2bd8428654 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090330 Jul 12 13:53:43.844263 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 561/1114] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Jul 12 13:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 13:53:44.044321 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-0bdd9454-8ddb-452d-8e9a-e09a6b694515 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:53:44.045087 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.compute.api [None req-0bdd9454-8ddb-452d-8e9a-e09a6b694515 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124465) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:53:44.052025 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0bdd9454-8ddb-452d-8e9a-e09a6b694515 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:44.052839 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0bdd9454-8ddb-452d-8e9a-e09a6b694515 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:44.053709 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0bdd9454-8ddb-452d-8e9a-e09a6b694515 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:44.054246 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG oslo_concurrency.lockutils [None req-0bdd9454-8ddb-452d-8e9a-e09a6b694515 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:44.135242 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.policy [None req-0bdd9454-8ddb-452d-8e9a-e09a6b694515 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd90f756d724016b60c80e9c78cce41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc981a893df54f079e63399ace23ef1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124465) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 13:53:44.146685 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-0bdd9454-8ddb-452d-8e9a-e09a6b694515 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 200 len: 1219 microversion: 2.1 time: 0.106083 Jul 12 13:53:44.147281 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 554/1115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:53:44 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 13:53:45.164896 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3902e379-c010-456b-82e5-3ba3c9a734e4 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '>' {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:53:45.165607 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.compute.api [None req-3902e379-c010-456b-82e5-3ba3c9a734e4 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] [instance: 5c9ed0f9-c449-4b4a-8440-a199c233faee] Fetching instance by UUID {{(pid=124466) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 13:53:45.172356 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3902e379-c010-456b-82e5-3ba3c9a734e4 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:45.172820 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3902e379-c010-456b-82e5-3ba3c9a734e4 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:45.173578 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3902e379-c010-456b-82e5-3ba3c9a734e4 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 13:53:45.174047 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG oslo_concurrency.lockutils [None req-3902e379-c010-456b-82e5-3ba3c9a734e4 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Lock "8c4e355e-53a6-4660-8086-68fb4f4fbe3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124466) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 13:53:45.190179 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.wsgi [None req-3902e379-c010-456b-82e5-3ba3c9a734e4 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] HTTP exception thrown: Instance 5c9ed0f9-c449-4b4a-8440-a199c233faee could not be found. Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3902e379-c010-456b-82e5-3ba3c9a734e4 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Request method failure captured: Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: request: GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee HTTP/1.1 Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept: application/json Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Accept-Encoding: identity Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Connection: close Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Length: 0 Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Content-Type: application/json Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Host: 10.222.0.52 Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Openstack-System-Scope: None Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: User-Agent: python-urllib3/1.26.9 Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Auth-Token: gAAAAABizXvMH-iXDZDYiik0oBbKRjcN2JB1uvfz1tCeCS3JPWW75eaCRXWvglFvpduKuauGZHm-15uMEX-bruvaJpKKQlA6EiQTniwY7CewR2cuf5-Cs8gq-8hOhRrSWFN3gJinF64MY-yeJQwywA-P-EDOpQ-ifmuQ1BR-FWn11pgw0j3rNu4 Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Id: None Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Domain-Name: None Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Identity-Status: Confirmed Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Is-Admin-Project: True Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Id: default Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Domain-Name: Default Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Id: dc981a893df54f079e63399ace23ef1c Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Project-Name: tempest-TestShelveInstance-2010638291 Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Role: member,reader Jul 12 13:53:45.191869 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Roles: member,reader Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc981a893df54f079e63399ace23ef1c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc981a893df54f079e63399ace23ef1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc981a893df54f079e63399ace23ef1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc981a893df54f079e63399ace23ef1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant: tempest-TestShelveInstance-2010638291 Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Id: dc981a893df54f079e63399ace23ef1c Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-Tenant-Name: tempest-TestShelveInstance-2010638291 Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User: tempest-TestShelveInstance-2010638291-project Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Id: default Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Domain-Name: Default Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Id: 3dd90f756d724016b60c80e9c78cce41 Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: X-User-Name: tempest-TestShelveInstance-2010638291-project Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: method: > Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: exception: Instance 5c9ed0f9-c449-4b4a-8440-a199c233faee could not be found. Jul 12 13:53:45.193639 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: action_args: {'id': '5c9ed0f9-c449-4b4a-8440-a199c233faee'} Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: {{(pid=124466) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9ed0f9-c449-4b4a-8440-a199c233faee could not be found. Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 13:53:45.194747 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9ed0f9-c449-4b4a-8440-a199c233faee could not be found. Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9ed0f9-c449-4b4a-8440-a199c233faee could not be found. Jul 12 13:53:45.196360 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: ERROR nova.api.openstack.wsgi Jul 12 13:53:45.198074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: DEBUG nova.api.openstack.wsgi [None req-3902e379-c010-456b-82e5-3ba3c9a734e4 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Returning 404 to user: Instance 5c9ed0f9-c449-4b4a-8440-a199c233faee could not be found. {{(pid=124466) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 13:53:45.198074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO nova.api.openstack.requestlog [None req-3902e379-c010-456b-82e5-3ba3c9a734e4 tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee" status: 404 len: 111 microversion: 2.1 time: 0.033165 Jul 12 13:53:45.198074 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: [pid: 124466|app: 0|req: 562/1116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Jul 12 13:53:45 2022] GET /compute/v2.1/servers/5c9ed0f9-c449-4b4a-8440-a199c233faee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 13:53:45.352458 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: DEBUG nova.api.openstack.wsgi [None req-b9657287-d4d0-4750-bf52-c8446604207f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] Calling method '.version_select at 0x7f3a15ac6280>' {{(pid=124465) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 13:53:45.373175 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO nova.api.openstack.requestlog [None req-b9657287-d4d0-4750-bf52-c8446604207f tempest-TestShelveInstance-2010638291 tempest-TestShelveInstance-2010638291-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2098390379" status: 202 len: 0 microversion: 2.1 time: 0.024351 Jul 12 13:53:45.373778 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: [pid: 124465|app: 0|req: 555/1117] 10.222.0.52 () {58 vars in 1253 bytes} [Tue Jul 12 13:53:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2098390379 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 13:55:23.510044 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:55:23.510693 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Tue Jul 12 13:55:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:55:26.335697 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:55:26.336435 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Tue Jul 12 13:55:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:55:29.579182 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:55:29.579817 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Tue Jul 12 13:55:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:58:43.519005 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:58:43.519620 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Tue Jul 12 13:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:58:46.343622 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:58:46.344220 dv-cinder-797970-4-iscsi devstack@n-api.service[124466]: Tue Jul 12 13:58:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:58:49.587414 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:58:49.588019 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Tue Jul 12 13:58:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:58:51.545419 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:58:51.546066 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Tue Jul 12 13:58:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 13:59:02.838398 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 13:59:02.839045 dv-cinder-797970-4-iscsi devstack@n-api.service[124465]: Tue Jul 12 13:59:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!